Command line
python /home/saxelrod/Repo/projects/chemprop/chemprop/train.py --config_path /home/saxelrod/chemprop_cov_1/models/from_whim_crest_weights_auc/config.json --data_path /home/saxelrod/rgb_nfs/dsets/cov_1_cl/train_full.csv --dataset_type classification
Args
{'activation': 'ReLU',
 'aggregation': 'mean',
 'aggregation_norm': 100,
 'atom_descriptors': None,
 'atom_descriptors_path': None,
 'atom_descriptors_size': 0,
 'atom_features_size': 0,
 'atom_messages': False,
 'batch_size': 50,
 'bias': False,
 'cache_cutoff': 10000,
 'checkpoint_dir': None,
 'checkpoint_path': None,
 'checkpoint_paths': None,
 'class_balance': True,
 'config_path': '/home/saxelrod/chemprop_cov_1/models/from_whim_crest_weights_auc/config.json',
 'crossval_index_dir': None,
 'crossval_index_file': None,
 'crossval_index_sets': None,
 'cuda': True,
 'data_path': '/home/saxelrod/rgb_nfs/dsets/cov_1_cl/train_full.csv',
 'dataset_type': 'classification',
 'depth': 6,
 'device': device(type='cuda', index=3),
 'dropout': 0.35000000000000003,
 'ensemble_size': 1,
 'epochs': 10000,
 'extra_metrics': [],
 'features_generator': None,
 'features_only': False,
 'features_path': ['/home/saxelrod/chemprop_cov_1/features/whim/train_whim_mean_crest_weights.npz',
                   '/home/saxelrod/chemprop_cov_1/features/whim/train_whim_std_crest_weights.npz'],
 'features_scaling': True,
 'features_size': None,
 'ffn_hidden_size': 1900,
 'ffn_num_layers': 3,
 'final_lr': 0.0001,
 'folds_file': None,
 'gpu': 3,
 'grad_clip': None,
 'hidden_size': 1900,
 'ignore_columns': None,
 'init_lr': 0.0001,
 'log_frequency': 10,
 'max_data_size': None,
 'max_lr': 0.001,
 'metric': 'auc',
 'metrics': ['auc'],
 'minimize_score': False,
 'mpn_shared': False,
 'multiclass_num_classes': 3,
 'no_cache_mol': False,
 'no_cuda': False,
 'no_features_scaling': False,
 'num_folds': 1,
 'num_lrs': 1,
 'num_tasks': 1,
 'num_workers': 8,
 'number_of_molecules': 1,
 'pytorch_seed': 0,
 'quiet': True,
 'save_dir': '/home/saxelrod/chemprop_cov_1/models/from_whim_crest_weights_auc',
 'save_preds': False,
 'save_smiles_splits': False,
 'seed': 0,
 'separate_test_features_path': ['/home/saxelrod/chemprop_cov_1/features/whim/test_whim_mean_crest_weights.npz',
                                 '/home/saxelrod/chemprop_cov_1/features/whim/test_whim_std_crest_weights.npz'],
 'separate_test_path': '/home/saxelrod/rgb_nfs/dsets/cov_1_cl/test_full.csv',
 'separate_val_features_path': ['/home/saxelrod/chemprop_cov_1/features/whim/val_whim_mean_crest_weights.npz',
                                '/home/saxelrod/chemprop_cov_1/features/whim/val_whim_std_crest_weights.npz'],
 'separate_val_path': '/home/saxelrod/rgb_nfs/dsets/cov_1_cl/val_full.csv',
 'show_individual_scores': False,
 'smiles_columns': [None],
 'split_sizes': (0.8, 0.1, 0.1),
 'split_type': 'random',
 'target_columns': None,
 'task_names': ['sars_cov_one_cl_protease_active'],
 'test': False,
 'test_fold_index': None,
 'train_data_size': None,
 'undirected': False,
 'use_input_features': True,
 'val_fold_index': None,
 'warmup_epochs': 2.0}
Loading data
Number of tasks = 1
Fold 0
Splitting data with seed 0
Class sizes
sars_cov_one_cl_protease_active 0: 99.84%, 1: 0.16%
Total size = 167,255 | train size = 167,255 | val size = 55,750 | test size = 55,756
With class_balance, effective train size = 550
Building model 0
MoleculeModel(
  (sigmoid): Sigmoid()
  (encoder): MPN(
    (encoder): ModuleList(
      (0): MPNEncoder(
        (dropout_layer): Dropout(p=0.35000000000000003, inplace=False)
        (act_func): ReLU()
        (W_i): Linear(in_features=147, out_features=1900, bias=False)
        (W_h): Linear(in_features=1900, out_features=1900, bias=False)
        (W_o): Linear(in_features=2033, out_features=1900, bias=True)
      )
    )
  )
  (ffn): Sequential(
    (0): Dropout(p=0.35000000000000003, inplace=False)
    (1): Linear(in_features=2128, out_features=1900, bias=True)
    (2): ReLU()
    (3): Dropout(p=0.35000000000000003, inplace=False)
    (4): Linear(in_features=1900, out_features=1900, bias=True)
    (5): ReLU()
    (6): Dropout(p=0.35000000000000003, inplace=False)
    (7): Linear(in_features=1900, out_features=1, bias=True)
  )
)
Number of parameters = 15,412,801
Moving model to cuda
Epoch 0
Loss = 7.1872e-01, PNorm = 89.7158, GNorm = 8.0542, lr_0 = 1.0148e-04
Validation auc = 0.583645
Epoch 1
Loss = 6.7754e-01, PNorm = 89.7244, GNorm = 2.5330, lr_0 = 1.0283e-04
Validation auc = 0.620409
Epoch 2
Loss = 6.5770e-01, PNorm = 89.7313, GNorm = 2.4446, lr_0 = 1.0417e-04
Validation auc = 0.667967
Epoch 3
Loss = 6.6397e-01, PNorm = 89.7380, GNorm = 2.2983, lr_0 = 1.0552e-04
Validation auc = 0.681316
Epoch 4
Loss = 6.2380e-01, PNorm = 89.7444, GNorm = 1.9805, lr_0 = 1.0686e-04
Validation auc = 0.687447
Epoch 5
Loss = 6.5077e-01, PNorm = 89.7501, GNorm = 2.2579, lr_0 = 1.0821e-04
Validation auc = 0.700062
Epoch 6
Loss = 5.8901e-01, PNorm = 89.7553, GNorm = 2.3082, lr_0 = 1.0955e-04
Validation auc = 0.719299
Epoch 7
Loss = 5.9818e-01, PNorm = 89.7614, GNorm = 2.3652, lr_0 = 1.1090e-04
Validation auc = 0.701060
Epoch 8
Loss = 6.3009e-01, PNorm = 89.7671, GNorm = 2.5795, lr_0 = 1.1224e-04
Validation auc = 0.707188
Epoch 9
Loss = 5.6281e-01, PNorm = 89.7734, GNorm = 2.2304, lr_0 = 1.1359e-04
Loss = 6.0750e-01, PNorm = 89.7793, GNorm = 2.1958, lr_0 = 1.1493e-04
Validation auc = 0.712833
Epoch 10
Loss = 5.7606e-01, PNorm = 89.7854, GNorm = 2.0449, lr_0 = 1.1628e-04
Validation auc = 0.705723
Epoch 11
Loss = 6.1471e-01, PNorm = 89.7918, GNorm = 1.8156, lr_0 = 1.1762e-04
Validation auc = 0.720692
Epoch 12
Loss = 6.1145e-01, PNorm = 89.7980, GNorm = 2.2523, lr_0 = 1.1897e-04
Validation auc = 0.716930
Epoch 13
Loss = 6.2163e-01, PNorm = 89.8045, GNorm = 2.1400, lr_0 = 1.2031e-04
Validation auc = 0.710566
Epoch 14
Loss = 6.1251e-01, PNorm = 89.8118, GNorm = 2.1084, lr_0 = 1.2166e-04
Validation auc = 0.706467
Epoch 15
Loss = 5.9566e-01, PNorm = 89.8196, GNorm = 2.0084, lr_0 = 1.2300e-04
Validation auc = 0.702911
Epoch 16
Loss = 5.6906e-01, PNorm = 89.8272, GNorm = 2.0341, lr_0 = 1.2435e-04
Validation auc = 0.710567
Epoch 17
Loss = 5.7423e-01, PNorm = 89.8354, GNorm = 2.2934, lr_0 = 1.2570e-04
Validation auc = 0.718820
Epoch 18
Loss = 5.2444e-01, PNorm = 89.8442, GNorm = 2.1490, lr_0 = 1.2704e-04
Validation auc = 0.697401
Epoch 19
Loss = 6.4412e-01, PNorm = 89.8537, GNorm = 2.2820, lr_0 = 1.2839e-04
Loss = 5.6838e-01, PNorm = 89.8629, GNorm = 1.6665, lr_0 = 1.2973e-04
Validation auc = 0.705844
Epoch 20
Loss = 5.7966e-01, PNorm = 89.8718, GNorm = 2.1452, lr_0 = 1.3108e-04
Validation auc = 0.719556
Epoch 21
Loss = 5.8883e-01, PNorm = 89.8809, GNorm = 1.9705, lr_0 = 1.3242e-04
Validation auc = 0.716017
Epoch 22
Loss = 5.7266e-01, PNorm = 89.8912, GNorm = 2.3773, lr_0 = 1.3377e-04
Validation auc = 0.719150
Epoch 23
Loss = 5.5763e-01, PNorm = 89.9023, GNorm = 2.4334, lr_0 = 1.3511e-04
Validation auc = 0.709023
Epoch 24
Loss = 5.4230e-01, PNorm = 89.9139, GNorm = 1.9878, lr_0 = 1.3646e-04
Validation auc = 0.717613
Epoch 25
Loss = 5.3058e-01, PNorm = 89.9271, GNorm = 2.4393, lr_0 = 1.3780e-04
Validation auc = 0.705472
Epoch 26
Loss = 5.4511e-01, PNorm = 89.9408, GNorm = 2.1179, lr_0 = 1.3915e-04
Validation auc = 0.720475
Epoch 27
Loss = 4.9002e-01, PNorm = 89.9555, GNorm = 2.2834, lr_0 = 1.4049e-04
Validation auc = 0.713680
Epoch 28
Loss = 5.0324e-01, PNorm = 89.9713, GNorm = 2.1034, lr_0 = 1.4184e-04
Validation auc = 0.715037
Epoch 29
Loss = 5.9836e-01, PNorm = 89.9857, GNorm = 2.2923, lr_0 = 1.4318e-04
Loss = 5.1782e-01, PNorm = 90.0003, GNorm = 3.2726, lr_0 = 1.4453e-04
Validation auc = 0.722386
Epoch 30
Loss = 5.6168e-01, PNorm = 90.0136, GNorm = 2.0579, lr_0 = 1.4587e-04
Validation auc = 0.684172
Epoch 31
Loss = 5.3962e-01, PNorm = 90.0285, GNorm = 2.4898, lr_0 = 1.4722e-04
Validation auc = 0.716635
Epoch 32
Loss = 5.1544e-01, PNorm = 90.0433, GNorm = 3.0076, lr_0 = 1.4857e-04
Validation auc = 0.704133
Epoch 33
Loss = 5.4772e-01, PNorm = 90.0568, GNorm = 2.3790, lr_0 = 1.4991e-04
Validation auc = 0.686329
Epoch 34
Loss = 5.6245e-01, PNorm = 90.0723, GNorm = 2.1717, lr_0 = 1.5126e-04
Validation auc = 0.694278
Epoch 35
Loss = 5.3370e-01, PNorm = 90.0888, GNorm = 1.8775, lr_0 = 1.5260e-04
Validation auc = 0.707001
Epoch 36
Loss = 5.4059e-01, PNorm = 90.1071, GNorm = 2.0792, lr_0 = 1.5395e-04
Validation auc = 0.681270
Epoch 37
Loss = 4.9343e-01, PNorm = 90.1264, GNorm = 2.5601, lr_0 = 1.5529e-04
Validation auc = 0.706100
Epoch 38
Loss = 5.1897e-01, PNorm = 90.1465, GNorm = 2.0424, lr_0 = 1.5664e-04
Validation auc = 0.705435
Epoch 39
Loss = 5.5446e-01, PNorm = 90.1694, GNorm = 3.5370, lr_0 = 1.5798e-04
Loss = 5.2587e-01, PNorm = 90.1892, GNorm = 1.5052, lr_0 = 1.5933e-04
Validation auc = 0.688428
Epoch 40
Loss = 5.2975e-01, PNorm = 90.2107, GNorm = 1.8379, lr_0 = 1.6067e-04
Validation auc = 0.701075
Epoch 41
Loss = 4.5569e-01, PNorm = 90.2326, GNorm = 1.7379, lr_0 = 1.6202e-04
Validation auc = 0.722460
Epoch 42
Loss = 4.6568e-01, PNorm = 90.2565, GNorm = 1.9328, lr_0 = 1.6336e-04
Validation auc = 0.693431
Epoch 43
Loss = 4.9003e-01, PNorm = 90.2820, GNorm = 2.3957, lr_0 = 1.6471e-04
Validation auc = 0.719081
Epoch 44
Loss = 5.1511e-01, PNorm = 90.3072, GNorm = 2.7107, lr_0 = 1.6605e-04
Validation auc = 0.708926
Epoch 45
Loss = 4.3299e-01, PNorm = 90.3332, GNorm = 3.1520, lr_0 = 1.6740e-04
Validation auc = 0.719058
Epoch 46
Loss = 4.2907e-01, PNorm = 90.3583, GNorm = 1.8855, lr_0 = 1.6874e-04
Validation auc = 0.712217
Epoch 47
Loss = 4.1834e-01, PNorm = 90.3831, GNorm = 2.6870, lr_0 = 1.7009e-04
Validation auc = 0.723350
Epoch 48
Loss = 4.4847e-01, PNorm = 90.4060, GNorm = 1.7297, lr_0 = 1.7143e-04
Validation auc = 0.711292
Epoch 49
Loss = 5.4297e-01, PNorm = 90.4323, GNorm = 2.6958, lr_0 = 1.7278e-04
Loss = 4.5298e-01, PNorm = 90.4581, GNorm = 3.4729, lr_0 = 1.7413e-04
Validation auc = 0.713984
Epoch 50
Loss = 4.4045e-01, PNorm = 90.4820, GNorm = 3.1299, lr_0 = 1.7547e-04
Validation auc = 0.717191
Epoch 51
Loss = 4.1069e-01, PNorm = 90.5105, GNorm = 2.9446, lr_0 = 1.7682e-04
Validation auc = 0.709524
Epoch 52
Loss = 4.2065e-01, PNorm = 90.5334, GNorm = 1.8867, lr_0 = 1.7816e-04
Validation auc = 0.742136
Epoch 53
Loss = 4.4702e-01, PNorm = 90.5599, GNorm = 2.0671, lr_0 = 1.7951e-04
Validation auc = 0.729115
Epoch 54
Loss = 4.9181e-01, PNorm = 90.5873, GNorm = 2.4568, lr_0 = 1.8085e-04
Validation auc = 0.730130
Epoch 55
Loss = 4.9197e-01, PNorm = 90.6149, GNorm = 3.3861, lr_0 = 1.8220e-04
Validation auc = 0.718912
Epoch 56
Loss = 4.7447e-01, PNorm = 90.6442, GNorm = 3.4490, lr_0 = 1.8354e-04
Validation auc = 0.726971
Epoch 57
Loss = 4.4676e-01, PNorm = 90.6731, GNorm = 3.3477, lr_0 = 1.8489e-04
Validation auc = 0.731155
Epoch 58
Loss = 3.8080e-01, PNorm = 90.7010, GNorm = 2.0283, lr_0 = 1.8623e-04
Validation auc = 0.725727
Epoch 59
Loss = 4.5011e-01, PNorm = 90.7335, GNorm = 1.9232, lr_0 = 1.8758e-04
Loss = 4.1131e-01, PNorm = 90.7684, GNorm = 2.0134, lr_0 = 1.8892e-04
Validation auc = 0.712863
Epoch 60
Loss = 3.7379e-01, PNorm = 90.8008, GNorm = 1.6912, lr_0 = 1.9027e-04
Validation auc = 0.724768
Epoch 61
Loss = 4.3297e-01, PNorm = 90.8354, GNorm = 2.0172, lr_0 = 1.9161e-04
Validation auc = 0.727486
Epoch 62
Loss = 4.0016e-01, PNorm = 90.8709, GNorm = 1.8484, lr_0 = 1.9296e-04
Validation auc = 0.736459
Epoch 63
Loss = 3.6356e-01, PNorm = 90.9052, GNorm = 3.3806, lr_0 = 1.9430e-04
Validation auc = 0.727461
Epoch 64
Loss = 3.3673e-01, PNorm = 90.9368, GNorm = 1.7827, lr_0 = 1.9565e-04
Validation auc = 0.725306
Epoch 65
Loss = 4.0442e-01, PNorm = 90.9673, GNorm = 4.5443, lr_0 = 1.9700e-04
Validation auc = 0.730158
Epoch 66
Loss = 3.6187e-01, PNorm = 91.0021, GNorm = 3.0645, lr_0 = 1.9834e-04
Validation auc = 0.732517
Epoch 67
Loss = 3.9291e-01, PNorm = 91.0379, GNorm = 3.5814, lr_0 = 1.9969e-04
Validation auc = 0.720251
Epoch 68
Loss = 3.7666e-01, PNorm = 91.0771, GNorm = 2.2630, lr_0 = 2.0103e-04
Validation auc = 0.745384
Epoch 69
Loss = 2.8514e-01, PNorm = 91.1201, GNorm = 2.1893, lr_0 = 2.0238e-04
Loss = 3.4621e-01, PNorm = 91.1617, GNorm = 2.1181, lr_0 = 2.0372e-04
Validation auc = 0.742070
Epoch 70
Loss = 3.4387e-01, PNorm = 91.2015, GNorm = 2.2748, lr_0 = 2.0507e-04
Validation auc = 0.732328
Epoch 71
Loss = 3.4049e-01, PNorm = 91.2441, GNorm = 2.2263, lr_0 = 2.0641e-04
Validation auc = 0.742485
Epoch 72
Loss = 3.9407e-01, PNorm = 91.2813, GNorm = 2.5167, lr_0 = 2.0776e-04
Validation auc = 0.735219
Epoch 73
Loss = 3.0559e-01, PNorm = 91.3249, GNorm = 2.0579, lr_0 = 2.0910e-04
Validation auc = 0.756179
Epoch 74
Loss = 3.4114e-01, PNorm = 91.3646, GNorm = 2.3307, lr_0 = 2.1045e-04
Validation auc = 0.726108
Epoch 75
Loss = 2.6266e-01, PNorm = 91.4071, GNorm = 2.5391, lr_0 = 2.1179e-04
Validation auc = 0.739071
Epoch 76
Loss = 2.9462e-01, PNorm = 91.4494, GNorm = 1.9412, lr_0 = 2.1314e-04
Validation auc = 0.714628
Epoch 77
Loss = 3.0188e-01, PNorm = 91.4949, GNorm = 3.8366, lr_0 = 2.1448e-04
Validation auc = 0.725888
Epoch 78
Loss = 2.9054e-01, PNorm = 91.5460, GNorm = 7.6533, lr_0 = 2.1583e-04
Validation auc = 0.724737
Epoch 79
Loss = 3.1171e-01, PNorm = 91.5952, GNorm = 1.7091, lr_0 = 2.1717e-04
Loss = 3.4315e-01, PNorm = 91.6421, GNorm = 1.9343, lr_0 = 2.1852e-04
Validation auc = 0.740354
Epoch 80
Loss = 2.9040e-01, PNorm = 91.6882, GNorm = 1.8334, lr_0 = 2.1987e-04
Validation auc = 0.736980
Epoch 81
Loss = 2.9852e-01, PNorm = 91.7302, GNorm = 4.3207, lr_0 = 2.2121e-04
Validation auc = 0.734012
Epoch 82
Loss = 3.2881e-01, PNorm = 91.7736, GNorm = 1.7700, lr_0 = 2.2256e-04
Validation auc = 0.722034
Epoch 83
Loss = 3.0685e-01, PNorm = 91.8231, GNorm = 9.1662, lr_0 = 2.2390e-04
Validation auc = 0.725114
Epoch 84
Loss = 2.3654e-01, PNorm = 91.8730, GNorm = 2.6644, lr_0 = 2.2525e-04
Validation auc = 0.739478
Epoch 85
Loss = 3.1096e-01, PNorm = 91.9180, GNorm = 3.1810, lr_0 = 2.2659e-04
Validation auc = 0.729924
Epoch 86
Loss = 2.8235e-01, PNorm = 91.9691, GNorm = 2.2145, lr_0 = 2.2794e-04
Validation auc = 0.742863
Epoch 87
Loss = 3.6201e-01, PNorm = 92.0203, GNorm = 3.0007, lr_0 = 2.2928e-04
Validation auc = 0.740233
Epoch 88
Loss = 2.5924e-01, PNorm = 92.0734, GNorm = 1.7572, lr_0 = 2.3063e-04
Validation auc = 0.737144
Epoch 89
Loss = 3.1660e-01, PNorm = 92.1204, GNorm = 2.4604, lr_0 = 2.3197e-04
Loss = 2.2706e-01, PNorm = 92.1650, GNorm = 3.3137, lr_0 = 2.3332e-04
Validation auc = 0.735308
Epoch 90
Loss = 2.4030e-01, PNorm = 92.2142, GNorm = 2.1443, lr_0 = 2.3466e-04
Validation auc = 0.744522
Epoch 91
Loss = 2.2950e-01, PNorm = 92.2628, GNorm = 2.5318, lr_0 = 2.3601e-04
Validation auc = 0.739153
Epoch 92
Loss = 2.5172e-01, PNorm = 92.3163, GNorm = 3.7982, lr_0 = 2.3735e-04
Validation auc = 0.738492
Epoch 93
Loss = 2.5208e-01, PNorm = 92.3710, GNorm = 3.8895, lr_0 = 2.3870e-04
Validation auc = 0.735674
Epoch 94
Loss = 2.7231e-01, PNorm = 92.4281, GNorm = 4.0260, lr_0 = 2.4004e-04
Validation auc = 0.740992
Epoch 95
Loss = 2.9448e-01, PNorm = 92.4883, GNorm = 2.9418, lr_0 = 2.4139e-04
Validation auc = 0.742349
Epoch 96
Loss = 2.4439e-01, PNorm = 92.5467, GNorm = 1.9989, lr_0 = 2.4274e-04
Validation auc = 0.744551
Epoch 97
Loss = 2.0014e-01, PNorm = 92.5961, GNorm = 1.5143, lr_0 = 2.4408e-04
Validation auc = 0.758907
Epoch 98
Loss = 2.5327e-01, PNorm = 92.6480, GNorm = 2.5672, lr_0 = 2.4543e-04
Validation auc = 0.745733
Epoch 99
Loss = 3.2778e-01, PNorm = 92.7014, GNorm = 2.7194, lr_0 = 2.4677e-04
Loss = 2.2901e-01, PNorm = 92.7532, GNorm = 2.6549, lr_0 = 2.4812e-04
Validation auc = 0.717923
Epoch 100
Loss = 2.1014e-01, PNorm = 92.8043, GNorm = 3.0429, lr_0 = 2.4946e-04
Validation auc = 0.736172
Epoch 101
Loss = 2.4427e-01, PNorm = 92.8560, GNorm = 1.5079, lr_0 = 2.5081e-04
Validation auc = 0.742343
Epoch 102
Loss = 2.0021e-01, PNorm = 92.9096, GNorm = 4.1625, lr_0 = 2.5215e-04
Validation auc = 0.750427
Epoch 103
Loss = 2.4519e-01, PNorm = 92.9624, GNorm = 2.5366, lr_0 = 2.5350e-04
Validation auc = 0.742519
Epoch 104
Loss = 2.3474e-01, PNorm = 93.0181, GNorm = 2.3423, lr_0 = 2.5484e-04
Validation auc = 0.746735
Epoch 105
Loss = 2.0388e-01, PNorm = 93.0745, GNorm = 1.7800, lr_0 = 2.5619e-04
Validation auc = 0.737136
Epoch 106
Loss = 1.4923e-01, PNorm = 93.1262, GNorm = 1.0427, lr_0 = 2.5753e-04
Validation auc = 0.713338
Epoch 107
Loss = 3.1074e-01, PNorm = 93.1731, GNorm = 1.7708, lr_0 = 2.5888e-04
Validation auc = 0.741326
Epoch 108
Loss = 3.3702e-01, PNorm = 93.2270, GNorm = 3.6999, lr_0 = 2.6022e-04
Validation auc = 0.728374
Epoch 109
Loss = 1.9676e-01, PNorm = 93.2908, GNorm = 2.3882, lr_0 = 2.6157e-04
Loss = 1.9652e-01, PNorm = 93.3477, GNorm = 3.1856, lr_0 = 2.6291e-04
Validation auc = 0.747119
Epoch 110
Loss = 2.1511e-01, PNorm = 93.4014, GNorm = 3.4220, lr_0 = 2.6426e-04
Validation auc = 0.744819
Epoch 111
Loss = 2.0612e-01, PNorm = 93.4524, GNorm = 5.5723, lr_0 = 2.6561e-04
Validation auc = 0.747602
Epoch 112
Loss = 1.6481e-01, PNorm = 93.5068, GNorm = 1.3023, lr_0 = 2.6695e-04
Validation auc = 0.764545
Epoch 113
Loss = 1.5910e-01, PNorm = 93.5607, GNorm = 3.5318, lr_0 = 2.6830e-04
Validation auc = 0.747673
Epoch 114
Loss = 1.7143e-01, PNorm = 93.6019, GNorm = 2.0132, lr_0 = 2.6964e-04
Validation auc = 0.753075
Epoch 115
Loss = 1.7965e-01, PNorm = 93.6499, GNorm = 1.5275, lr_0 = 2.7099e-04
Validation auc = 0.752471
Epoch 116
Loss = 1.3943e-01, PNorm = 93.7064, GNorm = 1.5438, lr_0 = 2.7233e-04
Validation auc = 0.758043
Epoch 117
Loss = 1.2110e-01, PNorm = 93.7678, GNorm = 1.3657, lr_0 = 2.7368e-04
Validation auc = 0.732541
Epoch 118
Loss = 3.8100e-01, PNorm = 93.8292, GNorm = 5.4048, lr_0 = 2.7502e-04
Validation auc = 0.752778
Epoch 119
Loss = 9.4961e-02, PNorm = 93.9051, GNorm = 1.5235, lr_0 = 2.7637e-04
Loss = 1.7607e-01, PNorm = 93.9731, GNorm = 1.1451, lr_0 = 2.7771e-04
Validation auc = 0.740398
Epoch 120
Loss = 1.6287e-01, PNorm = 94.0323, GNorm = 2.8986, lr_0 = 2.7906e-04
Validation auc = 0.743187
Epoch 121
Loss = 2.1363e-01, PNorm = 94.0893, GNorm = 3.9670, lr_0 = 2.8040e-04
Validation auc = 0.741573
Epoch 122
Loss = 2.0745e-01, PNorm = 94.1526, GNorm = 1.8636, lr_0 = 2.8175e-04
Validation auc = 0.739332
Epoch 123
Loss = 1.5021e-01, PNorm = 94.2140, GNorm = 1.8284, lr_0 = 2.8309e-04
Validation auc = 0.731460
Epoch 124
Loss = 2.2881e-01, PNorm = 94.2803, GNorm = 1.4989, lr_0 = 2.8444e-04
Validation auc = 0.736144
Epoch 125
Loss = 1.9712e-01, PNorm = 94.3377, GNorm = 1.4817, lr_0 = 2.8578e-04
Validation auc = 0.752907
Epoch 126
Loss = 1.4076e-01, PNorm = 94.3899, GNorm = 3.1466, lr_0 = 2.8713e-04
Validation auc = 0.730822
Epoch 127
Loss = 1.3804e-01, PNorm = 94.4500, GNorm = 2.8320, lr_0 = 2.8848e-04
Validation auc = 0.737749
Epoch 128
Loss = 2.1851e-01, PNorm = 94.5069, GNorm = 1.8533, lr_0 = 2.8982e-04
Validation auc = 0.751895
Epoch 129
Loss = 1.0600e-01, PNorm = 94.5710, GNorm = 2.0339, lr_0 = 2.9117e-04
Loss = 1.8424e-01, PNorm = 94.6279, GNorm = 1.8800, lr_0 = 2.9251e-04
Validation auc = 0.738436
Epoch 130
Loss = 1.2099e-01, PNorm = 94.6873, GNorm = 1.6367, lr_0 = 2.9386e-04
Validation auc = 0.729278
Epoch 131
Loss = 1.2154e-01, PNorm = 94.7402, GNorm = 2.3763, lr_0 = 2.9520e-04
Validation auc = 0.747361
Epoch 132
Loss = 1.2418e-01, PNorm = 94.7915, GNorm = 3.5011, lr_0 = 2.9655e-04
Validation auc = 0.734442
Epoch 133
Loss = 1.2871e-01, PNorm = 94.8419, GNorm = 2.3425, lr_0 = 2.9789e-04
Validation auc = 0.759744
Epoch 134
Loss = 1.0871e-01, PNorm = 94.8929, GNorm = 1.5347, lr_0 = 2.9924e-04
Validation auc = 0.768268
Epoch 135
Loss = 1.4364e-01, PNorm = 94.9383, GNorm = 4.4965, lr_0 = 3.0058e-04
Validation auc = 0.730181
Epoch 136
Loss = 2.0428e-01, PNorm = 95.0057, GNorm = 1.7371, lr_0 = 3.0193e-04
Validation auc = 0.755687
Epoch 137
Loss = 2.7384e-01, PNorm = 95.0785, GNorm = 4.2190, lr_0 = 3.0327e-04
Validation auc = 0.753402
Epoch 138
Loss = 1.5808e-01, PNorm = 95.1485, GNorm = 2.8319, lr_0 = 3.0462e-04
Validation auc = 0.719810
Epoch 139
Loss = 2.0135e-01, PNorm = 95.2126, GNorm = 1.8500, lr_0 = 3.0596e-04
Loss = 1.3077e-01, PNorm = 95.2674, GNorm = 2.1312, lr_0 = 3.0731e-04
Validation auc = 0.738986
Epoch 140
Loss = 1.3200e-01, PNorm = 95.3179, GNorm = 2.0028, lr_0 = 3.0865e-04
Validation auc = 0.737611
Epoch 141
Loss = 1.0078e-01, PNorm = 95.3710, GNorm = 2.2534, lr_0 = 3.1000e-04
Validation auc = 0.734028
Epoch 142
Loss = 1.3114e-01, PNorm = 95.4230, GNorm = 3.0363, lr_0 = 3.1135e-04
Validation auc = 0.744005
Epoch 143
Loss = 1.0162e-01, PNorm = 95.4763, GNorm = 2.0382, lr_0 = 3.1269e-04
Validation auc = 0.744610
Epoch 144
Loss = 1.4211e-01, PNorm = 95.5284, GNorm = 3.1083, lr_0 = 3.1404e-04
Validation auc = 0.745572
Epoch 145
Loss = 1.2899e-01, PNorm = 95.5881, GNorm = 3.9737, lr_0 = 3.1538e-04
Validation auc = 0.729209
Epoch 146
Loss = 1.4631e-01, PNorm = 95.6534, GNorm = 1.8793, lr_0 = 3.1673e-04
Validation auc = 0.752917
Epoch 147
Loss = 1.8257e-01, PNorm = 95.7283, GNorm = 2.0520, lr_0 = 3.1807e-04
Validation auc = 0.766127
Epoch 148
Loss = 1.4030e-01, PNorm = 95.7965, GNorm = 1.4709, lr_0 = 3.1942e-04
Validation auc = 0.745443
Epoch 149
Loss = 2.7134e-02, PNorm = 95.8619, GNorm = 0.7334, lr_0 = 3.2076e-04
Loss = 1.4230e-01, PNorm = 95.9218, GNorm = 1.8993, lr_0 = 3.2211e-04
Validation auc = 0.751656
Epoch 150
Loss = 1.5074e-01, PNorm = 95.9759, GNorm = 2.2879, lr_0 = 3.2345e-04
Validation auc = 0.750944
Epoch 151
Loss = 9.9822e-02, PNorm = 96.0327, GNorm = 1.7307, lr_0 = 3.2480e-04
Validation auc = 0.752988
Epoch 152
Loss = 1.0899e-01, PNorm = 96.0904, GNorm = 2.7154, lr_0 = 3.2614e-04
Validation auc = 0.756031
Epoch 153
Loss = 1.0239e-01, PNorm = 96.1468, GNorm = 2.2035, lr_0 = 3.2749e-04
Validation auc = 0.726609
Epoch 154
Loss = 1.4512e-01, PNorm = 96.2102, GNorm = 2.8967, lr_0 = 3.2883e-04
Validation auc = 0.755185
Epoch 155
Loss = 1.3560e-01, PNorm = 96.2826, GNorm = 1.4385, lr_0 = 3.3018e-04
Validation auc = 0.750979
Epoch 156
Loss = 1.2490e-01, PNorm = 96.3406, GNorm = 1.4817, lr_0 = 3.3152e-04
Validation auc = 0.742872
Epoch 157
Loss = 1.9082e-01, PNorm = 96.3993, GNorm = 2.7405, lr_0 = 3.3287e-04
Validation auc = 0.766718
Epoch 158
Loss = 1.5909e-01, PNorm = 96.4526, GNorm = 1.9745, lr_0 = 3.3422e-04
Validation auc = 0.762594
Epoch 159
Loss = 5.3968e-02, PNorm = 96.5121, GNorm = 1.4981, lr_0 = 3.3556e-04
Loss = 1.1243e-01, PNorm = 96.5685, GNorm = 1.4423, lr_0 = 3.3691e-04
Validation auc = 0.742357
Epoch 160
Loss = 9.6129e-02, PNorm = 96.6222, GNorm = 0.9111, lr_0 = 3.3825e-04
Validation auc = 0.766664
Epoch 161
Loss = 1.2199e-01, PNorm = 96.6800, GNorm = 2.1301, lr_0 = 3.3960e-04
Validation auc = 0.742271
Epoch 162
Loss = 7.6771e-02, PNorm = 96.7564, GNorm = 1.7000, lr_0 = 3.4094e-04
Validation auc = 0.730283
Epoch 163
Loss = 1.2311e-01, PNorm = 96.8163, GNorm = 2.7546, lr_0 = 3.4229e-04
Validation auc = 0.722450
Epoch 164
Loss = 5.7904e-02, PNorm = 96.8695, GNorm = 0.7459, lr_0 = 3.4363e-04
Validation auc = 0.735739
Epoch 165
Loss = 7.2211e-02, PNorm = 96.9258, GNorm = 1.5130, lr_0 = 3.4498e-04
Validation auc = 0.745381
Epoch 166
Loss = 8.4027e-02, PNorm = 96.9801, GNorm = 1.6874, lr_0 = 3.4632e-04
Validation auc = 0.752066
Epoch 167
Loss = 5.2810e-02, PNorm = 97.0513, GNorm = 2.6793, lr_0 = 3.4767e-04
Validation auc = 0.726432
Epoch 168
Loss = 2.2002e-01, PNorm = 97.1200, GNorm = 3.0377, lr_0 = 3.4901e-04
Validation auc = 0.730756
Epoch 169
Loss = 1.0221e-01, PNorm = 97.2011, GNorm = 1.2992, lr_0 = 3.5036e-04
Loss = 1.0560e-01, PNorm = 97.2777, GNorm = 1.6640, lr_0 = 3.5170e-04
Validation auc = 0.737855
Epoch 170
Loss = 7.8263e-02, PNorm = 97.3398, GNorm = 2.8598, lr_0 = 3.5305e-04
Validation auc = 0.743538
Epoch 171
Loss = 8.9377e-02, PNorm = 97.4016, GNorm = 0.6723, lr_0 = 3.5439e-04
Validation auc = 0.742912
Epoch 172
Loss = 1.2895e-01, PNorm = 97.4657, GNorm = 1.6486, lr_0 = 3.5574e-04
Validation auc = 0.742849
Epoch 173
Loss = 1.5931e-01, PNorm = 97.5482, GNorm = 0.8520, lr_0 = 3.5709e-04
Validation auc = 0.754346
Epoch 174
Loss = 1.4183e-01, PNorm = 97.6426, GNorm = 1.4668, lr_0 = 3.5843e-04
Validation auc = 0.740811
Epoch 175
Loss = 6.7792e-02, PNorm = 97.7233, GNorm = 0.9356, lr_0 = 3.5978e-04
Validation auc = 0.747523
Epoch 176
Loss = 7.7491e-02, PNorm = 97.7891, GNorm = 1.2280, lr_0 = 3.6112e-04
Validation auc = 0.729260
Epoch 177
Loss = 6.4490e-02, PNorm = 97.8566, GNorm = 2.0217, lr_0 = 3.6247e-04
Validation auc = 0.738898
Epoch 178
Loss = 7.8581e-02, PNorm = 97.9264, GNorm = 2.3094, lr_0 = 3.6381e-04
Validation auc = 0.740006
Epoch 179
Loss = 6.9846e-02, PNorm = 97.9859, GNorm = 1.1945, lr_0 = 3.6516e-04
Loss = 1.0068e-01, PNorm = 98.0357, GNorm = 1.4133, lr_0 = 3.6650e-04
Validation auc = 0.724495
Epoch 180
Loss = 9.7367e-02, PNorm = 98.0893, GNorm = 1.2616, lr_0 = 3.6785e-04
Validation auc = 0.731451
Epoch 181
Loss = 6.6633e-02, PNorm = 98.1537, GNorm = 1.7132, lr_0 = 3.6919e-04
Validation auc = 0.730469
Epoch 182
Loss = 1.3784e-01, PNorm = 98.2162, GNorm = 4.8195, lr_0 = 3.7054e-04
Validation auc = 0.767181
Epoch 183
Loss = 8.4466e-02, PNorm = 98.2855, GNorm = 2.0616, lr_0 = 3.7188e-04
Validation auc = 0.744333
Epoch 184
Loss = 8.0802e-02, PNorm = 98.3522, GNorm = 1.4559, lr_0 = 3.7323e-04
Validation auc = 0.751520
Epoch 185
Loss = 8.7201e-02, PNorm = 98.4282, GNorm = 1.6164, lr_0 = 3.7457e-04
Validation auc = 0.763297
Epoch 186
Loss = 4.5448e-02, PNorm = 98.5055, GNorm = 1.4561, lr_0 = 3.7592e-04
Validation auc = 0.732062
Epoch 187
Loss = 1.1146e-01, PNorm = 98.5741, GNorm = 1.2286, lr_0 = 3.7726e-04
Validation auc = 0.746888
Epoch 188
Loss = 4.3904e-02, PNorm = 98.6379, GNorm = 1.4130, lr_0 = 3.7861e-04
Validation auc = 0.750058
Epoch 189
Loss = 5.6063e-02, PNorm = 98.6903, GNorm = 1.3788, lr_0 = 3.7996e-04
Loss = 5.0916e-02, PNorm = 98.7319, GNorm = 2.9776, lr_0 = 3.8130e-04
Validation auc = 0.739644
Epoch 190
Loss = 1.0047e-01, PNorm = 98.7771, GNorm = 4.2205, lr_0 = 3.8265e-04
Validation auc = 0.744627
Epoch 191
Loss = 1.0086e-01, PNorm = 98.8450, GNorm = 3.5430, lr_0 = 3.8399e-04
Validation auc = 0.739755
Epoch 192
Loss = 5.4542e-02, PNorm = 98.9184, GNorm = 1.3553, lr_0 = 3.8534e-04
Validation auc = 0.754405
Epoch 193
Loss = 1.0428e-01, PNorm = 98.9957, GNorm = 1.8747, lr_0 = 3.8668e-04
Validation auc = 0.711210
Epoch 194
Loss = 1.9183e-01, PNorm = 99.0704, GNorm = 2.9637, lr_0 = 3.8803e-04
Validation auc = 0.723821
Epoch 195
Loss = 1.2910e-01, PNorm = 99.1641, GNorm = 1.1404, lr_0 = 3.8937e-04
Validation auc = 0.729164
Epoch 196
Loss = 1.3557e-01, PNorm = 99.2673, GNorm = 3.6907, lr_0 = 3.9072e-04
Validation auc = 0.740349
Epoch 197
Loss = 1.0594e-01, PNorm = 99.3743, GNorm = 1.4648, lr_0 = 3.9206e-04
Validation auc = 0.737062
Epoch 198
Loss = 1.1166e-01, PNorm = 99.4594, GNorm = 2.3304, lr_0 = 3.9341e-04
Validation auc = 0.747568
Epoch 199
Loss = 9.8807e-02, PNorm = 99.5272, GNorm = 1.3817, lr_0 = 3.9475e-04
Loss = 7.8495e-02, PNorm = 99.5759, GNorm = 4.0198, lr_0 = 3.9610e-04
Validation auc = 0.733115
Epoch 200
Loss = 1.2198e-01, PNorm = 99.6418, GNorm = 0.8417, lr_0 = 3.9744e-04
Validation auc = 0.731876
Epoch 201
Loss = 1.1130e-01, PNorm = 99.7311, GNorm = 2.4203, lr_0 = 3.9879e-04
Validation auc = 0.748825
Epoch 202
Loss = 1.8871e-01, PNorm = 99.8226, GNorm = 3.2357, lr_0 = 4.0013e-04
Validation auc = 0.741839
Epoch 203
Loss = 1.3121e-01, PNorm = 99.9190, GNorm = 1.0068, lr_0 = 4.0148e-04
Validation auc = 0.744901
Epoch 204
Loss = 9.2757e-02, PNorm = 100.0018, GNorm = 2.5489, lr_0 = 4.0283e-04
Validation auc = 0.735757
Epoch 205
Loss = 8.1625e-02, PNorm = 100.0726, GNorm = 3.1057, lr_0 = 4.0417e-04
Validation auc = 0.727061
Epoch 206
Loss = 9.2952e-02, PNorm = 100.1340, GNorm = 1.7622, lr_0 = 4.0552e-04
Validation auc = 0.737881
Epoch 207
Loss = 5.0912e-02, PNorm = 100.2159, GNorm = 0.9579, lr_0 = 4.0686e-04
Validation auc = 0.730859
Epoch 208
Loss = 1.6528e-01, PNorm = 100.2880, GNorm = 2.8658, lr_0 = 4.0821e-04
Validation auc = 0.716473
Epoch 209
Loss = 9.9135e-02, PNorm = 100.3546, GNorm = 2.0093, lr_0 = 4.0955e-04
Loss = 1.0068e-01, PNorm = 100.4190, GNorm = 2.0272, lr_0 = 4.1090e-04
Validation auc = 0.732009
Epoch 210
Loss = 5.6417e-02, PNorm = 100.4778, GNorm = 1.7403, lr_0 = 4.1224e-04
Validation auc = 0.749644
Epoch 211
Loss = 4.9608e-02, PNorm = 100.5303, GNorm = 0.7640, lr_0 = 4.1359e-04
Validation auc = 0.742206
Epoch 212
Loss = 4.5076e-02, PNorm = 100.5792, GNorm = 0.3704, lr_0 = 4.1493e-04
Validation auc = 0.736174
Epoch 213
Loss = 4.4841e-02, PNorm = 100.6258, GNorm = 0.1367, lr_0 = 4.1628e-04
Validation auc = 0.735415
Epoch 214
Loss = 5.7908e-02, PNorm = 100.6814, GNorm = 2.4703, lr_0 = 4.1762e-04
Validation auc = 0.747025
Epoch 215
Loss = 9.1818e-02, PNorm = 100.7572, GNorm = 2.2472, lr_0 = 4.1897e-04
Validation auc = 0.728628
Epoch 216
Loss = 9.1381e-02, PNorm = 100.8456, GNorm = 1.7792, lr_0 = 4.2031e-04
Validation auc = 0.769509
Epoch 217
Loss = 1.1630e-01, PNorm = 100.9346, GNorm = 1.2751, lr_0 = 4.2166e-04
Validation auc = 0.708108
Epoch 218
Loss = 1.1582e-01, PNorm = 101.0315, GNorm = 1.4353, lr_0 = 4.2300e-04
Validation auc = 0.733784
Epoch 219
Loss = 1.8103e-01, PNorm = 101.1380, GNorm = 3.4681, lr_0 = 4.2435e-04
Loss = 1.1210e-01, PNorm = 101.2469, GNorm = 1.5998, lr_0 = 4.2570e-04
Validation auc = 0.735513
Epoch 220
Loss = 1.1231e-01, PNorm = 101.3499, GNorm = 3.3485, lr_0 = 4.2704e-04
Validation auc = 0.746509
Epoch 221
Loss = 6.9265e-02, PNorm = 101.4528, GNorm = 0.5178, lr_0 = 4.2839e-04
Validation auc = 0.726681
Epoch 222
Loss = 8.2460e-02, PNorm = 101.5331, GNorm = 1.5385, lr_0 = 4.2973e-04
Validation auc = 0.742980
Epoch 223
Loss = 7.5876e-02, PNorm = 101.6260, GNorm = 2.0831, lr_0 = 4.3108e-04
Validation auc = 0.752567
Epoch 224
Loss = 1.0077e-01, PNorm = 101.7357, GNorm = 2.5866, lr_0 = 4.3242e-04
Validation auc = 0.724697
Epoch 225
Loss = 9.4717e-02, PNorm = 101.8586, GNorm = 1.8902, lr_0 = 4.3377e-04
Validation auc = 0.743577
Epoch 226
Loss = 9.4836e-02, PNorm = 101.9561, GNorm = 2.2272, lr_0 = 4.3511e-04
Validation auc = 0.748277
Epoch 227
Loss = 4.8512e-02, PNorm = 102.0365, GNorm = 1.7890, lr_0 = 4.3646e-04
Validation auc = 0.752550
Epoch 228
Loss = 4.1114e-02, PNorm = 102.1154, GNorm = 0.3399, lr_0 = 4.3780e-04
Validation auc = 0.755001
Epoch 229
Loss = 5.7350e-02, PNorm = 102.1919, GNorm = 1.3307, lr_0 = 4.3915e-04
Loss = 6.3718e-02, PNorm = 102.2627, GNorm = 1.5567, lr_0 = 4.4049e-04
Validation auc = 0.755859
Epoch 230
Loss = 5.5369e-02, PNorm = 102.3254, GNorm = 0.5232, lr_0 = 4.4184e-04
Validation auc = 0.731637
Epoch 231
Loss = 4.8886e-02, PNorm = 102.3857, GNorm = 0.6392, lr_0 = 4.4318e-04
Validation auc = 0.730920
Epoch 232
Loss = 4.1127e-02, PNorm = 102.4508, GNorm = 1.6803, lr_0 = 4.4453e-04
Validation auc = 0.756758
Epoch 233
Loss = 7.7688e-02, PNorm = 102.5138, GNorm = 0.7521, lr_0 = 4.4587e-04
Validation auc = 0.764475
Epoch 234
Loss = 9.5344e-02, PNorm = 102.5788, GNorm = 2.5135, lr_0 = 4.4722e-04
Validation auc = 0.758867
Epoch 235
Loss = 5.7230e-02, PNorm = 102.6490, GNorm = 3.1492, lr_0 = 4.4857e-04
Validation auc = 0.762029
Epoch 236
Loss = 1.1312e-01, PNorm = 102.7078, GNorm = 1.9003, lr_0 = 4.4991e-04
Validation auc = 0.744958
Epoch 237
Loss = 1.1503e-01, PNorm = 102.7658, GNorm = 1.7820, lr_0 = 4.5126e-04
Validation auc = 0.738863
Epoch 238
Loss = 1.0629e-01, PNorm = 102.8360, GNorm = 0.9051, lr_0 = 4.5260e-04
Validation auc = 0.744871
Epoch 239
Loss = 5.4691e-02, PNorm = 102.9079, GNorm = 1.3640, lr_0 = 4.5395e-04
Loss = 8.1956e-02, PNorm = 102.9776, GNorm = 1.0821, lr_0 = 4.5529e-04
Validation auc = 0.764860
Epoch 240
Loss = 5.6517e-02, PNorm = 103.0580, GNorm = 1.3000, lr_0 = 4.5664e-04
Validation auc = 0.727696
Epoch 241
Loss = 7.9843e-02, PNorm = 103.1469, GNorm = 2.0501, lr_0 = 4.5798e-04
Validation auc = 0.737246
Epoch 242
Loss = 7.6244e-02, PNorm = 103.2414, GNorm = 2.9752, lr_0 = 4.5933e-04
Validation auc = 0.746935
Epoch 243
Loss = 8.6129e-02, PNorm = 103.3300, GNorm = 3.0506, lr_0 = 4.6067e-04
Validation auc = 0.751652
Epoch 244
Loss = 7.8774e-02, PNorm = 103.4223, GNorm = 0.6036, lr_0 = 4.6202e-04
Validation auc = 0.743879
Epoch 245
Loss = 1.3183e-01, PNorm = 103.5251, GNorm = 4.1559, lr_0 = 4.6336e-04
Validation auc = 0.722034
Epoch 246
Loss = 1.0472e-01, PNorm = 103.6352, GNorm = 2.1373, lr_0 = 4.6471e-04
Validation auc = 0.750977
Epoch 247
Loss = 7.9814e-02, PNorm = 103.7386, GNorm = 1.3900, lr_0 = 4.6605e-04
Validation auc = 0.743652
Epoch 248
Loss = 8.6926e-02, PNorm = 103.8242, GNorm = 1.7188, lr_0 = 4.6740e-04
Validation auc = 0.728370
Epoch 249
Loss = 9.1086e-02, PNorm = 103.9216, GNorm = 0.8621, lr_0 = 4.6874e-04
Loss = 1.0705e-01, PNorm = 104.0078, GNorm = 1.6250, lr_0 = 4.7009e-04
Validation auc = 0.743181
Epoch 250
Loss = 4.7361e-02, PNorm = 104.0852, GNorm = 0.7248, lr_0 = 4.7143e-04
Validation auc = 0.746463
Epoch 251
Loss = 2.5135e-02, PNorm = 104.1471, GNorm = 1.2159, lr_0 = 4.7278e-04
Validation auc = 0.763062
Epoch 252
Loss = 5.9132e-02, PNorm = 104.1877, GNorm = 0.4789, lr_0 = 4.7413e-04
Validation auc = 0.721613
Epoch 253
Loss = 8.2969e-02, PNorm = 104.2415, GNorm = 3.1730, lr_0 = 4.7547e-04
Validation auc = 0.753703
Epoch 254
Loss = 6.9959e-02, PNorm = 104.3207, GNorm = 0.5727, lr_0 = 4.7682e-04
Validation auc = 0.758214
Epoch 255
Loss = 8.3222e-02, PNorm = 104.4073, GNorm = 1.9691, lr_0 = 4.7816e-04
Validation auc = 0.775310
Epoch 256
Loss = 4.3629e-02, PNorm = 104.5050, GNorm = 0.7218, lr_0 = 4.7951e-04
Validation auc = 0.746218
Epoch 257
Loss = 1.3507e-01, PNorm = 104.6081, GNorm = 4.2492, lr_0 = 4.8085e-04
Validation auc = 0.757777
Epoch 258
Loss = 8.5296e-02, PNorm = 104.7191, GNorm = 1.3700, lr_0 = 4.8220e-04
Validation auc = 0.751173
Epoch 259
Loss = 7.4268e-02, PNorm = 104.8233, GNorm = 1.7046, lr_0 = 4.8354e-04
Loss = 8.6044e-02, PNorm = 104.9168, GNorm = 2.9946, lr_0 = 4.8489e-04
Validation auc = 0.749102
Epoch 260
Loss = 8.3559e-02, PNorm = 104.9976, GNorm = 1.3806, lr_0 = 4.8623e-04
Validation auc = 0.736390
Epoch 261
Loss = 1.0861e-01, PNorm = 105.0844, GNorm = 0.5472, lr_0 = 4.8758e-04
Validation auc = 0.770210
Epoch 262
Loss = 9.3004e-02, PNorm = 105.1852, GNorm = 1.7415, lr_0 = 4.8892e-04
Validation auc = 0.755576
Epoch 263
Loss = 1.2271e-01, PNorm = 105.2775, GNorm = 1.2896, lr_0 = 4.9027e-04
Validation auc = 0.758035
Epoch 264
Loss = 7.9934e-02, PNorm = 105.3615, GNorm = 0.4280, lr_0 = 4.9161e-04
Validation auc = 0.781771
Epoch 265
Loss = 5.3243e-02, PNorm = 105.4387, GNorm = 1.0329, lr_0 = 4.9296e-04
Validation auc = 0.757954
Epoch 266
Loss = 9.0938e-02, PNorm = 105.5127, GNorm = 2.5768, lr_0 = 4.9430e-04
Validation auc = 0.748627
Epoch 267
Loss = 3.0993e-02, PNorm = 105.6021, GNorm = 0.7445, lr_0 = 4.9565e-04
Validation auc = 0.755875
Epoch 268
Loss = 2.9452e-02, PNorm = 105.6827, GNorm = 0.8641, lr_0 = 4.9700e-04
Validation auc = 0.739486
Epoch 269
Loss = 1.2311e-02, PNorm = 105.7528, GNorm = 0.3372, lr_0 = 4.9834e-04
Loss = 6.4045e-02, PNorm = 105.8287, GNorm = 2.2485, lr_0 = 4.9969e-04
Validation auc = 0.744905
Epoch 270
Loss = 6.5668e-02, PNorm = 105.9051, GNorm = 1.3168, lr_0 = 5.0103e-04
Validation auc = 0.716476
Epoch 271
Loss = 7.1515e-02, PNorm = 105.9856, GNorm = 0.2334, lr_0 = 5.0238e-04
Validation auc = 0.739279
Epoch 272
Loss = 7.0680e-02, PNorm = 106.0672, GNorm = 1.5586, lr_0 = 5.0372e-04
Validation auc = 0.738017
Epoch 273
Loss = 4.7455e-02, PNorm = 106.1429, GNorm = 0.7043, lr_0 = 5.0507e-04
Validation auc = 0.749934
Epoch 274
Loss = 9.2945e-02, PNorm = 106.2184, GNorm = 1.1299, lr_0 = 5.0641e-04
Validation auc = 0.759873
Epoch 275
Loss = 6.6462e-02, PNorm = 106.3236, GNorm = 0.3851, lr_0 = 5.0776e-04
Validation auc = 0.746327
Epoch 276
Loss = 3.6524e-02, PNorm = 106.4279, GNorm = 1.4269, lr_0 = 5.0910e-04
Validation auc = 0.773750
Epoch 277
Loss = 1.3750e-01, PNorm = 106.5277, GNorm = 1.7798, lr_0 = 5.1045e-04
Validation auc = 0.773480
Epoch 278
Loss = 2.1009e-01, PNorm = 106.6340, GNorm = 3.3619, lr_0 = 5.1179e-04
Validation auc = 0.748798
Epoch 279
Loss = 1.7695e-01, PNorm = 106.7708, GNorm = 2.1070, lr_0 = 5.1314e-04
Loss = 8.8721e-02, PNorm = 106.9244, GNorm = 1.7645, lr_0 = 5.1448e-04
Validation auc = 0.734875
Epoch 280
Loss = 1.0313e-01, PNorm = 107.0500, GNorm = 2.6333, lr_0 = 5.1583e-04
Validation auc = 0.745152
Epoch 281
Loss = 9.8531e-02, PNorm = 107.1629, GNorm = 1.9416, lr_0 = 5.1717e-04
Validation auc = 0.735478
Epoch 282
Loss = 4.6423e-02, PNorm = 107.2594, GNorm = 1.2517, lr_0 = 5.1852e-04
Validation auc = 0.723383
Epoch 283
Loss = 8.6227e-02, PNorm = 107.3340, GNorm = 1.6269, lr_0 = 5.1987e-04
Validation auc = 0.749785
Epoch 284
Loss = 6.3752e-02, PNorm = 107.4100, GNorm = 1.7501, lr_0 = 5.2121e-04
Validation auc = 0.761613
Epoch 285
Loss = 9.7336e-02, PNorm = 107.5062, GNorm = 0.5228, lr_0 = 5.2256e-04
Validation auc = 0.740478
Epoch 286
Loss = 7.6699e-02, PNorm = 107.6254, GNorm = 2.1696, lr_0 = 5.2390e-04
Validation auc = 0.752239
Epoch 287
Loss = 5.6104e-02, PNorm = 107.7510, GNorm = 0.7699, lr_0 = 5.2525e-04
Validation auc = 0.746584
Epoch 288
Loss = 1.1922e-01, PNorm = 107.8976, GNorm = 1.4257, lr_0 = 5.2659e-04
Validation auc = 0.736132
Epoch 289
Loss = 2.1145e-01, PNorm = 108.0621, GNorm = 2.0105, lr_0 = 5.2794e-04
Loss = 9.3391e-02, PNorm = 108.2104, GNorm = 1.7861, lr_0 = 5.2928e-04
Validation auc = 0.737647
Epoch 290
Loss = 9.6164e-02, PNorm = 108.3580, GNorm = 0.3662, lr_0 = 5.3063e-04
Validation auc = 0.735644
Epoch 291
Loss = 9.3151e-02, PNorm = 108.5160, GNorm = 2.8415, lr_0 = 5.3197e-04
Validation auc = 0.739317
Epoch 292
Loss = 7.8134e-02, PNorm = 108.6819, GNorm = 2.3254, lr_0 = 5.3332e-04
Validation auc = 0.746137
Epoch 293
Loss = 9.0238e-02, PNorm = 108.8145, GNorm = 0.8292, lr_0 = 5.3466e-04
Validation auc = 0.728566
Epoch 294
Loss = 7.7978e-02, PNorm = 108.9488, GNorm = 1.0254, lr_0 = 5.3601e-04
Validation auc = 0.748403
Epoch 295
Loss = 6.4885e-02, PNorm = 109.0729, GNorm = 0.4455, lr_0 = 5.3735e-04
Validation auc = 0.758574
Epoch 296
Loss = 1.2456e-01, PNorm = 109.1955, GNorm = 2.3202, lr_0 = 5.3870e-04
Validation auc = 0.723000
Epoch 297
Loss = 5.7837e-02, PNorm = 109.3365, GNorm = 0.8640, lr_0 = 5.4004e-04
Validation auc = 0.739272
Epoch 298
Loss = 9.2080e-02, PNorm = 109.4816, GNorm = 1.4463, lr_0 = 5.4139e-04
Validation auc = 0.677419
Epoch 299
Loss = 1.8073e-01, PNorm = 109.6278, GNorm = 2.8109, lr_0 = 5.4274e-04
Loss = 9.6791e-02, PNorm = 109.7556, GNorm = 1.3085, lr_0 = 5.4408e-04
Validation auc = 0.740590
Epoch 300
Loss = 7.3665e-02, PNorm = 109.8747, GNorm = 0.2963, lr_0 = 5.4543e-04
Validation auc = 0.752105
Epoch 301
Loss = 3.2509e-02, PNorm = 109.9760, GNorm = 0.2572, lr_0 = 5.4677e-04
Validation auc = 0.748547
Epoch 302
Loss = 9.0313e-02, PNorm = 110.0580, GNorm = 1.3390, lr_0 = 5.4812e-04
Validation auc = 0.750364
Epoch 303
Loss = 4.6450e-02, PNorm = 110.1613, GNorm = 1.8922, lr_0 = 5.4946e-04
Validation auc = 0.741248
Epoch 304
Loss = 7.1760e-02, PNorm = 110.2529, GNorm = 0.9338, lr_0 = 5.5081e-04
Validation auc = 0.724563
Epoch 305
Loss = 6.9657e-02, PNorm = 110.3538, GNorm = 2.7741, lr_0 = 5.5215e-04
Validation auc = 0.738533
Epoch 306
Loss = 1.0454e-01, PNorm = 110.4667, GNorm = 2.4647, lr_0 = 5.5350e-04
Validation auc = 0.719489
Epoch 307
Loss = 8.6812e-02, PNorm = 110.5961, GNorm = 1.0489, lr_0 = 5.5484e-04
Validation auc = 0.712621
Epoch 308
Loss = 8.2630e-02, PNorm = 110.7187, GNorm = 1.7987, lr_0 = 5.5619e-04
Validation auc = 0.727697
Epoch 309
Loss = 8.1352e-02, PNorm = 110.8238, GNorm = 2.9979, lr_0 = 5.5753e-04
Loss = 5.4891e-02, PNorm = 110.9319, GNorm = 1.0331, lr_0 = 5.5888e-04
Validation auc = 0.736652
Epoch 310
Loss = 5.3801e-02, PNorm = 111.0405, GNorm = 2.8188, lr_0 = 5.6022e-04
Validation auc = 0.734657
Epoch 311
Loss = 1.0598e-01, PNorm = 111.1352, GNorm = 1.3192, lr_0 = 5.6157e-04
Validation auc = 0.733627
Epoch 312
Loss = 1.0399e-01, PNorm = 111.2535, GNorm = 5.8610, lr_0 = 5.6291e-04
Validation auc = 0.720689
Epoch 313
Loss = 6.4773e-02, PNorm = 111.3813, GNorm = 2.3870, lr_0 = 5.6426e-04
Validation auc = 0.717321
Epoch 314
Loss = 6.7594e-02, PNorm = 111.4906, GNorm = 0.8454, lr_0 = 5.6561e-04
Validation auc = 0.726725
Epoch 315
Loss = 5.5706e-02, PNorm = 111.5845, GNorm = 0.3870, lr_0 = 5.6695e-04
Validation auc = 0.725502
Epoch 316
Loss = 2.7863e-02, PNorm = 111.6664, GNorm = 0.8896, lr_0 = 5.6830e-04
Validation auc = 0.738371
Epoch 317
Loss = 4.0324e-02, PNorm = 111.7404, GNorm = 0.6969, lr_0 = 5.6964e-04
Validation auc = 0.742128
Epoch 318
Loss = 6.2799e-02, PNorm = 111.8310, GNorm = 0.4524, lr_0 = 5.7099e-04
Validation auc = 0.747986
Epoch 319
Loss = 2.5508e-02, PNorm = 111.9507, GNorm = 0.7935, lr_0 = 5.7233e-04
Loss = 7.0674e-02, PNorm = 112.0784, GNorm = 1.9710, lr_0 = 5.7368e-04
Validation auc = 0.743707
Epoch 320
Loss = 7.1567e-02, PNorm = 112.1994, GNorm = 1.3171, lr_0 = 5.7502e-04
Validation auc = 0.738867
Epoch 321
Loss = 6.0918e-02, PNorm = 112.3169, GNorm = 0.8710, lr_0 = 5.7637e-04
Validation auc = 0.738015
Epoch 322
Loss = 3.6751e-02, PNorm = 112.4159, GNorm = 0.4723, lr_0 = 5.7771e-04
Validation auc = 0.728049
Epoch 323
Loss = 3.9301e-02, PNorm = 112.4993, GNorm = 1.2037, lr_0 = 5.7906e-04
Validation auc = 0.706516
Epoch 324
Loss = 6.6249e-02, PNorm = 112.5954, GNorm = 1.3287, lr_0 = 5.8040e-04
Validation auc = 0.742435
Epoch 325
Loss = 1.6333e-01, PNorm = 112.7241, GNorm = 0.8246, lr_0 = 5.8175e-04
Validation auc = 0.725886
Epoch 326
Loss = 5.2367e-02, PNorm = 112.8951, GNorm = 1.4466, lr_0 = 5.8309e-04
Validation auc = 0.728889
Epoch 327
Loss = 5.9673e-02, PNorm = 113.0602, GNorm = 1.6574, lr_0 = 5.8444e-04
Validation auc = 0.744706
Epoch 328
Loss = 7.6507e-02, PNorm = 113.2252, GNorm = 1.7035, lr_0 = 5.8578e-04
Validation auc = 0.774021
Epoch 329
Loss = 1.2678e-01, PNorm = 113.4268, GNorm = 1.5184, lr_0 = 5.8713e-04
Loss = 5.3247e-02, PNorm = 113.5967, GNorm = 0.6860, lr_0 = 5.8848e-04
Validation auc = 0.719501
Epoch 330
Loss = 5.2808e-02, PNorm = 113.7214, GNorm = 1.0729, lr_0 = 5.8982e-04
Validation auc = 0.727907
Epoch 331
Loss = 7.6582e-02, PNorm = 113.8224, GNorm = 0.6988, lr_0 = 5.9117e-04
Validation auc = 0.760757
Epoch 332
Loss = 5.5653e-02, PNorm = 113.9365, GNorm = 0.6853, lr_0 = 5.9251e-04
Validation auc = 0.748371
Epoch 333
Loss = 5.6618e-02, PNorm = 114.0356, GNorm = 0.4442, lr_0 = 5.9386e-04
Validation auc = 0.742324
Epoch 334
Loss = 5.8249e-02, PNorm = 114.1151, GNorm = 1.6935, lr_0 = 5.9520e-04
Validation auc = 0.755157
Epoch 335
Loss = 8.1189e-02, PNorm = 114.2130, GNorm = 1.4069, lr_0 = 5.9655e-04
Validation auc = 0.746182
Epoch 336
Loss = 8.2863e-02, PNorm = 114.3228, GNorm = 0.8702, lr_0 = 5.9789e-04
Validation auc = 0.746776
Epoch 337
Loss = 9.1496e-02, PNorm = 114.4397, GNorm = 1.5709, lr_0 = 5.9924e-04
Validation auc = 0.757449
Epoch 338
Loss = 1.9287e-02, PNorm = 114.5714, GNorm = 0.6944, lr_0 = 6.0058e-04
Validation auc = 0.742999
Epoch 339
Loss = 7.5747e-02, PNorm = 114.6884, GNorm = 1.9835, lr_0 = 6.0193e-04
Loss = 4.4929e-02, PNorm = 114.8029, GNorm = 1.5589, lr_0 = 6.0327e-04
Validation auc = 0.737851
Epoch 340
Loss = 5.2454e-02, PNorm = 114.9309, GNorm = 1.3780, lr_0 = 6.0462e-04
Validation auc = 0.739026
Epoch 341
Loss = 7.1331e-02, PNorm = 115.0608, GNorm = 4.1501, lr_0 = 6.0596e-04
Validation auc = 0.748999
Epoch 342
Loss = 1.0712e-01, PNorm = 115.2385, GNorm = 4.0403, lr_0 = 6.0731e-04
Validation auc = 0.757624
Epoch 343
Loss = 8.0438e-02, PNorm = 115.4274, GNorm = 1.6122, lr_0 = 6.0865e-04
Validation auc = 0.756614
Epoch 344
Loss = 1.0514e-01, PNorm = 115.6253, GNorm = 1.6056, lr_0 = 6.1000e-04
Validation auc = 0.734516
Epoch 345
Loss = 1.3395e-01, PNorm = 115.8021, GNorm = 1.4926, lr_0 = 6.1135e-04
Validation auc = 0.762689
Epoch 346
Loss = 8.1197e-02, PNorm = 115.9663, GNorm = 1.2117, lr_0 = 6.1269e-04
Validation auc = 0.773848
Epoch 347
Loss = 8.1082e-02, PNorm = 116.1326, GNorm = 0.3363, lr_0 = 6.1404e-04
Validation auc = 0.766719
Epoch 348
Loss = 3.4520e-02, PNorm = 116.2660, GNorm = 1.3361, lr_0 = 6.1538e-04
Validation auc = 0.760696
Epoch 349
Loss = 8.9756e-02, PNorm = 116.3714, GNorm = 0.7957, lr_0 = 6.1673e-04
Loss = 2.3814e-02, PNorm = 116.4573, GNorm = 0.8367, lr_0 = 6.1807e-04
Validation auc = 0.759374
Epoch 350
Loss = 5.1579e-02, PNorm = 116.5197, GNorm = 0.7799, lr_0 = 6.1942e-04
Validation auc = 0.761517
Epoch 351
Loss = 5.3673e-02, PNorm = 116.5921, GNorm = 2.8706, lr_0 = 6.2076e-04
Validation auc = 0.761853
Epoch 352
Loss = 5.1601e-02, PNorm = 116.7145, GNorm = 1.1189, lr_0 = 6.2211e-04
Validation auc = 0.762668
Epoch 353
Loss = 5.7867e-02, PNorm = 116.8388, GNorm = 1.7594, lr_0 = 6.2345e-04
Validation auc = 0.756020
Epoch 354
Loss = 5.6904e-02, PNorm = 116.9751, GNorm = 0.1456, lr_0 = 6.2480e-04
Validation auc = 0.757511
Epoch 355
Loss = 8.7716e-02, PNorm = 117.1290, GNorm = 0.3691, lr_0 = 6.2614e-04
Validation auc = 0.758576
Epoch 356
Loss = 5.3505e-02, PNorm = 117.2910, GNorm = 0.2363, lr_0 = 6.2749e-04
Validation auc = 0.768759
Epoch 357
Loss = 4.4367e-02, PNorm = 117.4223, GNorm = 1.2799, lr_0 = 6.2883e-04
Validation auc = 0.751581
Epoch 358
Loss = 6.0264e-02, PNorm = 117.5425, GNorm = 0.7862, lr_0 = 6.3018e-04
Validation auc = 0.756063
Epoch 359
Loss = 7.9089e-02, PNorm = 117.6637, GNorm = 1.2450, lr_0 = 6.3152e-04
Loss = 6.7949e-02, PNorm = 117.7834, GNorm = 2.0384, lr_0 = 6.3287e-04
Validation auc = 0.744550
Epoch 360
Loss = 3.6115e-02, PNorm = 117.9090, GNorm = 1.3176, lr_0 = 6.3422e-04
Validation auc = 0.782270
Epoch 361
Loss = 7.0775e-02, PNorm = 118.0206, GNorm = 1.7550, lr_0 = 6.3556e-04
Validation auc = 0.762238
Epoch 362
Loss = 3.1062e-02, PNorm = 118.1452, GNorm = 0.9025, lr_0 = 6.3691e-04
Validation auc = 0.752805
Epoch 363
Loss = 3.3991e-02, PNorm = 118.2324, GNorm = 1.6869, lr_0 = 6.3825e-04
Validation auc = 0.748739
Epoch 364
Loss = 4.4706e-02, PNorm = 118.3060, GNorm = 0.2930, lr_0 = 6.3960e-04
Validation auc = 0.769249
Epoch 365
Loss = 4.0466e-02, PNorm = 118.3848, GNorm = 1.6585, lr_0 = 6.4094e-04
Validation auc = 0.773843
Epoch 366
Loss = 8.1783e-02, PNorm = 118.4610, GNorm = 0.7841, lr_0 = 6.4229e-04
Validation auc = 0.759134
Epoch 367
Loss = 6.7493e-02, PNorm = 118.5550, GNorm = 1.6484, lr_0 = 6.4363e-04
Validation auc = 0.745302
Epoch 368
Loss = 3.9656e-02, PNorm = 118.6574, GNorm = 1.0580, lr_0 = 6.4498e-04
Validation auc = 0.748339
Epoch 369
Loss = 3.6743e-02, PNorm = 118.7823, GNorm = 1.1263, lr_0 = 6.4632e-04
Loss = 8.2343e-02, PNorm = 118.9381, GNorm = 1.3363, lr_0 = 6.4767e-04
Validation auc = 0.771945
Epoch 370
Loss = 1.2202e-01, PNorm = 119.1394, GNorm = 2.1657, lr_0 = 6.4901e-04
Validation auc = 0.763391
Epoch 371
Loss = 9.6741e-02, PNorm = 119.3542, GNorm = 0.5062, lr_0 = 6.5036e-04
Validation auc = 0.761705
Epoch 372
Loss = 1.0881e-01, PNorm = 119.5398, GNorm = 0.4110, lr_0 = 6.5170e-04
Validation auc = 0.761317
Epoch 373
Loss = 9.1668e-02, PNorm = 119.7150, GNorm = 0.7188, lr_0 = 6.5305e-04
Validation auc = 0.762318
Epoch 374
Loss = 7.6916e-02, PNorm = 119.8923, GNorm = 1.1191, lr_0 = 6.5439e-04
Validation auc = 0.764789
Epoch 375
Loss = 5.9637e-02, PNorm = 120.0560, GNorm = 1.4771, lr_0 = 6.5574e-04
Validation auc = 0.764955
Epoch 376
Loss = 6.4638e-02, PNorm = 120.1864, GNorm = 2.1709, lr_0 = 6.5709e-04
Validation auc = 0.744566
Epoch 377
Loss = 1.1721e-01, PNorm = 120.3131, GNorm = 0.7736, lr_0 = 6.5843e-04
Validation auc = 0.729582
Epoch 378
Loss = 1.4359e-02, PNorm = 120.4581, GNorm = 0.2786, lr_0 = 6.5978e-04
Validation auc = 0.746933
Epoch 379
Loss = 1.8082e-02, PNorm = 120.6027, GNorm = 0.3688, lr_0 = 6.6112e-04
Loss = 2.9933e-02, PNorm = 120.7297, GNorm = 0.2915, lr_0 = 6.6247e-04
Validation auc = 0.750449
Epoch 380
Loss = 6.3073e-02, PNorm = 120.8267, GNorm = 2.7361, lr_0 = 6.6381e-04
Validation auc = 0.744508
Epoch 381
Loss = 3.8584e-02, PNorm = 120.9381, GNorm = 0.5495, lr_0 = 6.6516e-04
Validation auc = 0.746417
Epoch 382
Loss = 7.3126e-02, PNorm = 121.0642, GNorm = 2.1320, lr_0 = 6.6650e-04
Validation auc = 0.731632
Epoch 383
Loss = 6.5020e-02, PNorm = 121.2103, GNorm = 2.1952, lr_0 = 6.6785e-04
Validation auc = 0.751012
Epoch 384
Loss = 9.0483e-02, PNorm = 121.3373, GNorm = 1.8172, lr_0 = 6.6919e-04
Validation auc = 0.745251
Epoch 385
Loss = 5.1536e-02, PNorm = 121.4777, GNorm = 0.9895, lr_0 = 6.7054e-04
Validation auc = 0.743530
Epoch 386
Loss = 1.1123e-01, PNorm = 121.6126, GNorm = 0.6712, lr_0 = 6.7188e-04
Validation auc = 0.738722
Epoch 387
Loss = 9.8449e-02, PNorm = 121.7432, GNorm = 0.4556, lr_0 = 6.7323e-04
Validation auc = 0.721047
Epoch 388
Loss = 1.1028e-02, PNorm = 121.8736, GNorm = 0.0924, lr_0 = 6.7457e-04
Validation auc = 0.722091
Epoch 389
Loss = 4.9846e-02, PNorm = 121.9776, GNorm = 1.1437, lr_0 = 6.7592e-04
Loss = 5.6028e-02, PNorm = 122.0769, GNorm = 1.5736, lr_0 = 6.7726e-04
Validation auc = 0.748622
Epoch 390
Loss = 4.8546e-02, PNorm = 122.1886, GNorm = 3.5177, lr_0 = 6.7861e-04
Validation auc = 0.754429
Epoch 391
Loss = 7.5400e-02, PNorm = 122.3213, GNorm = 0.4370, lr_0 = 6.7996e-04
Validation auc = 0.742402
Epoch 392
Loss = 5.9309e-02, PNorm = 122.4738, GNorm = 1.0663, lr_0 = 6.8130e-04
Validation auc = 0.738980
Epoch 393
Loss = 5.8893e-02, PNorm = 122.6176, GNorm = 1.0547, lr_0 = 6.8265e-04
Validation auc = 0.754739
Epoch 394
Loss = 3.2071e-02, PNorm = 122.7509, GNorm = 1.8733, lr_0 = 6.8399e-04
Validation auc = 0.755747
Epoch 395
Loss = 3.2877e-02, PNorm = 122.8533, GNorm = 1.7654, lr_0 = 6.8534e-04
Validation auc = 0.736550
Epoch 396
Loss = 5.7793e-02, PNorm = 122.9506, GNorm = 1.3023, lr_0 = 6.8668e-04
Validation auc = 0.730222
Epoch 397
Loss = 5.6860e-02, PNorm = 123.0834, GNorm = 1.1482, lr_0 = 6.8803e-04
Validation auc = 0.742663
Epoch 398
Loss = 3.7051e-02, PNorm = 123.2506, GNorm = 1.1146, lr_0 = 6.8937e-04
Validation auc = 0.758571
Epoch 399
Loss = 2.1110e-01, PNorm = 123.4727, GNorm = 1.5635, lr_0 = 6.9072e-04
Loss = 1.2223e-01, PNorm = 123.7190, GNorm = 0.8251, lr_0 = 6.9206e-04
Validation auc = 0.748798
Epoch 400
Loss = 8.2755e-02, PNorm = 123.9463, GNorm = 0.6091, lr_0 = 6.9341e-04
Validation auc = 0.759234
Epoch 401
Loss = 7.1510e-02, PNorm = 124.1179, GNorm = 1.1785, lr_0 = 6.9475e-04
Validation auc = 0.728178
Epoch 402
Loss = 5.3250e-02, PNorm = 124.2843, GNorm = 0.2851, lr_0 = 6.9610e-04
Validation auc = 0.741804
Epoch 403
Loss = 4.0717e-02, PNorm = 124.4410, GNorm = 1.2114, lr_0 = 6.9744e-04
Validation auc = 0.744093
Epoch 404
Loss = 4.3535e-02, PNorm = 124.5618, GNorm = 0.1327, lr_0 = 6.9879e-04
Validation auc = 0.713349
Epoch 405
Loss = 5.2429e-02, PNorm = 124.6894, GNorm = 0.9927, lr_0 = 7.0013e-04
Validation auc = 0.765717
Epoch 406
Loss = 1.1656e-01, PNorm = 124.8470, GNorm = 3.7591, lr_0 = 7.0148e-04
Validation auc = 0.728143
Epoch 407
Loss = 4.2132e-02, PNorm = 125.0605, GNorm = 1.3193, lr_0 = 7.0283e-04
Validation auc = 0.731907
Epoch 408
Loss = 1.8286e-01, PNorm = 125.2595, GNorm = 2.1432, lr_0 = 7.0417e-04
Validation auc = 0.754272
Epoch 409
Loss = 5.7150e-02, PNorm = 125.4708, GNorm = 1.3106, lr_0 = 7.0552e-04
Loss = 8.7238e-02, PNorm = 125.6996, GNorm = 0.9368, lr_0 = 7.0686e-04
Validation auc = 0.759254
Epoch 410
Loss = 4.9829e-02, PNorm = 125.8962, GNorm = 0.8898, lr_0 = 7.0821e-04
Validation auc = 0.728621
Epoch 411
Loss = 7.8226e-02, PNorm = 126.0593, GNorm = 1.5862, lr_0 = 7.0955e-04
Validation auc = 0.716339
Epoch 412
Loss = 1.0556e-01, PNorm = 126.2558, GNorm = 1.7131, lr_0 = 7.1090e-04
Validation auc = 0.736378
Epoch 413
Loss = 1.0246e-01, PNorm = 126.4705, GNorm = 3.2248, lr_0 = 7.1224e-04
Validation auc = 0.743864
Epoch 414
Loss = 5.7978e-02, PNorm = 126.6602, GNorm = 1.6498, lr_0 = 7.1359e-04
Validation auc = 0.747326
Epoch 415
Loss = 4.0171e-02, PNorm = 126.8279, GNorm = 0.6206, lr_0 = 7.1493e-04
Validation auc = 0.733005
Epoch 416
Loss = 1.1962e-01, PNorm = 126.9768, GNorm = 1.8083, lr_0 = 7.1628e-04
Validation auc = 0.726938
Epoch 417
Loss = 9.9549e-02, PNorm = 127.1592, GNorm = 1.9017, lr_0 = 7.1762e-04
Validation auc = 0.730724
Epoch 418
Loss = 1.1709e-01, PNorm = 127.3704, GNorm = 2.9339, lr_0 = 7.1897e-04
Validation auc = 0.744699
Epoch 419
Loss = 8.3994e-02, PNorm = 127.6146, GNorm = 1.9212, lr_0 = 7.2031e-04
Loss = 7.3498e-02, PNorm = 127.9003, GNorm = 1.9976, lr_0 = 7.2166e-04
Validation auc = 0.779170
Epoch 420
Loss = 1.1853e-01, PNorm = 128.1546, GNorm = 0.5877, lr_0 = 7.2300e-04
Validation auc = 0.749728
Epoch 421
Loss = 1.3507e-01, PNorm = 128.3920, GNorm = 2.5729, lr_0 = 7.2435e-04
Validation auc = 0.753956
Epoch 422
Loss = 8.6978e-02, PNorm = 128.7044, GNorm = 0.6378, lr_0 = 7.2570e-04
Validation auc = 0.755688
Epoch 423
Loss = 9.0158e-02, PNorm = 128.9519, GNorm = 0.9708, lr_0 = 7.2704e-04
Validation auc = 0.758106
Epoch 424
Loss = 7.1773e-02, PNorm = 129.1341, GNorm = 0.8596, lr_0 = 7.2839e-04
Validation auc = 0.723901
Epoch 425
Loss = 5.0588e-02, PNorm = 129.2955, GNorm = 0.9234, lr_0 = 7.2973e-04
Validation auc = 0.742491
Epoch 426
Loss = 7.0885e-02, PNorm = 129.4536, GNorm = 0.7300, lr_0 = 7.3108e-04
Validation auc = 0.764837
Epoch 427
Loss = 5.4168e-02, PNorm = 129.6298, GNorm = 1.4621, lr_0 = 7.3242e-04
Validation auc = 0.731948
Epoch 428
Loss = 9.4399e-02, PNorm = 129.8389, GNorm = 0.4942, lr_0 = 7.3377e-04
Validation auc = 0.741831
Epoch 429
Loss = 5.7834e-03, PNorm = 130.0418, GNorm = 0.1130, lr_0 = 7.3511e-04
Loss = 5.1763e-02, PNorm = 130.1948, GNorm = 1.7145, lr_0 = 7.3646e-04
Validation auc = 0.763044
Epoch 430
Loss = 4.8153e-02, PNorm = 130.3274, GNorm = 1.7034, lr_0 = 7.3780e-04
Validation auc = 0.756325
Epoch 431
Loss = 7.8688e-02, PNorm = 130.4778, GNorm = 2.7070, lr_0 = 7.3915e-04
Validation auc = 0.738744
Epoch 432
Loss = 6.4549e-02, PNorm = 130.6628, GNorm = 0.5859, lr_0 = 7.4049e-04
Validation auc = 0.732985
Epoch 433
Loss = 5.2763e-02, PNorm = 130.8534, GNorm = 1.5503, lr_0 = 7.4184e-04
Validation auc = 0.731345
Epoch 434
Loss = 6.9823e-02, PNorm = 131.0141, GNorm = 1.9254, lr_0 = 7.4318e-04
Validation auc = 0.720619
Epoch 435
Loss = 4.9865e-02, PNorm = 131.1569, GNorm = 0.9963, lr_0 = 7.4453e-04
Validation auc = 0.733620
Epoch 436
Loss = 7.3207e-02, PNorm = 131.2944, GNorm = 0.7940, lr_0 = 7.4587e-04
Validation auc = 0.717948
Epoch 437
Loss = 4.6289e-02, PNorm = 131.4297, GNorm = 2.2359, lr_0 = 7.4722e-04
Validation auc = 0.705573
Epoch 438
Loss = 1.0107e-01, PNorm = 131.5949, GNorm = 1.9053, lr_0 = 7.4857e-04
Validation auc = 0.713895
Epoch 439
Loss = 1.3762e-02, PNorm = 131.7839, GNorm = 1.0825, lr_0 = 7.4991e-04
Loss = 9.3298e-02, PNorm = 131.9569, GNorm = 1.5796, lr_0 = 7.5126e-04
Validation auc = 0.738989
Epoch 440
Loss = 4.4433e-02, PNorm = 132.1443, GNorm = 0.4465, lr_0 = 7.5260e-04
Validation auc = 0.735386
Epoch 441
Loss = 8.8076e-02, PNorm = 132.3437, GNorm = 0.9825, lr_0 = 7.5395e-04
Validation auc = 0.739519
Epoch 442
Loss = 5.1196e-02, PNorm = 132.5869, GNorm = 0.7945, lr_0 = 7.5529e-04
Validation auc = 0.735878
Epoch 443
Loss = 5.7858e-02, PNorm = 132.7754, GNorm = 1.9390, lr_0 = 7.5664e-04
Validation auc = 0.745583
Epoch 444
Loss = 9.5763e-02, PNorm = 132.9701, GNorm = 2.6271, lr_0 = 7.5798e-04
Validation auc = 0.769715
Epoch 445
Loss = 6.8213e-02, PNorm = 133.1802, GNorm = 1.3514, lr_0 = 7.5933e-04
Validation auc = 0.753626
Epoch 446
Loss = 2.9028e-02, PNorm = 133.3698, GNorm = 0.6467, lr_0 = 7.6067e-04
Validation auc = 0.733409
Epoch 447
Loss = 9.1711e-02, PNorm = 133.5294, GNorm = 1.7265, lr_0 = 7.6202e-04
Validation auc = 0.753157
Epoch 448
Loss = 8.6727e-02, PNorm = 133.6958, GNorm = 1.7677, lr_0 = 7.6336e-04
Validation auc = 0.743903
Epoch 449
Loss = 2.6730e-01, PNorm = 133.9332, GNorm = 2.7197, lr_0 = 7.6471e-04
Loss = 7.7908e-02, PNorm = 134.1834, GNorm = 2.2946, lr_0 = 7.6605e-04
Validation auc = 0.743164
Epoch 450
Loss = 8.3627e-02, PNorm = 134.4433, GNorm = 2.3545, lr_0 = 7.6740e-04
Validation auc = 0.718673
Epoch 451
Loss = 6.9935e-02, PNorm = 134.6816, GNorm = 0.3462, lr_0 = 7.6874e-04
Validation auc = 0.756809
Epoch 452
Loss = 8.8648e-02, PNorm = 134.8805, GNorm = 0.1087, lr_0 = 7.7009e-04
Validation auc = 0.736810
Epoch 453
Loss = 7.5785e-02, PNorm = 135.1344, GNorm = 1.1160, lr_0 = 7.7143e-04
Validation auc = 0.746466
Epoch 454
Loss = 1.0263e-01, PNorm = 135.3743, GNorm = 0.4190, lr_0 = 7.7278e-04
Validation auc = 0.746334
Epoch 455
Loss = 2.6975e-02, PNorm = 135.5873, GNorm = 0.1692, lr_0 = 7.7413e-04
Validation auc = 0.732797
Epoch 456
Loss = 7.3100e-02, PNorm = 135.7592, GNorm = 0.9125, lr_0 = 7.7547e-04
Validation auc = 0.746554
Epoch 457
Loss = 7.1293e-02, PNorm = 135.9324, GNorm = 0.0598, lr_0 = 7.7682e-04
Validation auc = 0.734271
Epoch 458
Loss = 4.4671e-02, PNorm = 136.0963, GNorm = 0.2478, lr_0 = 7.7816e-04
Validation auc = 0.740916
Epoch 459
Loss = 2.2589e-02, PNorm = 136.2890, GNorm = 0.8376, lr_0 = 7.7951e-04
Loss = 5.8325e-02, PNorm = 136.4809, GNorm = 0.3848, lr_0 = 7.8085e-04
Validation auc = 0.763569
Epoch 460
Loss = 1.2513e-01, PNorm = 136.6822, GNorm = 2.3187, lr_0 = 7.8220e-04
Validation auc = 0.712254
Epoch 461
Loss = 8.7403e-02, PNorm = 137.0005, GNorm = 0.8510, lr_0 = 7.8354e-04
Validation auc = 0.764177
Epoch 462
Loss = 1.3627e-01, PNorm = 137.2641, GNorm = 1.4373, lr_0 = 7.8489e-04
Validation auc = 0.743345
Epoch 463
Loss = 9.5655e-02, PNorm = 137.4991, GNorm = 0.9289, lr_0 = 7.8623e-04
Validation auc = 0.742281
Epoch 464
Loss = 1.0522e-01, PNorm = 137.7053, GNorm = 2.7929, lr_0 = 7.8758e-04
Validation auc = 0.707030
Epoch 465
Loss = 6.9452e-02, PNorm = 137.9204, GNorm = 1.6410, lr_0 = 7.8892e-04
Validation auc = 0.717222
Epoch 466
Loss = 9.8808e-02, PNorm = 138.1022, GNorm = 1.4890, lr_0 = 7.9027e-04
Validation auc = 0.721755
Epoch 467
Loss = 4.4326e-02, PNorm = 138.2458, GNorm = 0.2263, lr_0 = 7.9161e-04
Validation auc = 0.713656
Epoch 468
Loss = 1.6017e-02, PNorm = 138.3918, GNorm = 0.2664, lr_0 = 7.9296e-04
Validation auc = 0.724025
Epoch 469
Loss = 5.0053e-02, PNorm = 138.5319, GNorm = 1.4830, lr_0 = 7.9430e-04
Loss = 8.8287e-02, PNorm = 138.6783, GNorm = 3.9903, lr_0 = 7.9565e-04
Validation auc = 0.699805
Epoch 470
Loss = 1.1725e-01, PNorm = 138.8733, GNorm = 5.2725, lr_0 = 7.9700e-04
Validation auc = 0.722983
Epoch 471
Loss = 8.4373e-02, PNorm = 139.1219, GNorm = 2.2256, lr_0 = 7.9834e-04
Validation auc = 0.742435
Epoch 472
Loss = 1.0672e-01, PNorm = 139.3835, GNorm = 0.5476, lr_0 = 7.9969e-04
Validation auc = 0.754117
Epoch 473
Loss = 7.8297e-02, PNorm = 139.6155, GNorm = 0.9031, lr_0 = 8.0103e-04
Validation auc = 0.736560
Epoch 474
Loss = 6.7642e-02, PNorm = 139.8444, GNorm = 1.5436, lr_0 = 8.0238e-04
Validation auc = 0.739889
Epoch 475
Loss = 6.6280e-02, PNorm = 140.0348, GNorm = 1.5787, lr_0 = 8.0372e-04
Validation auc = 0.747762
Epoch 476
Loss = 4.7166e-02, PNorm = 140.2064, GNorm = 0.5707, lr_0 = 8.0507e-04
Validation auc = 0.759189
Epoch 477
Loss = 2.7592e-02, PNorm = 140.3416, GNorm = 0.3814, lr_0 = 8.0641e-04
Validation auc = 0.769078
Epoch 478
Loss = 1.7293e-02, PNorm = 140.4757, GNorm = 0.4190, lr_0 = 8.0776e-04
Validation auc = 0.758403
Epoch 479
Loss = 3.2748e-02, PNorm = 140.6731, GNorm = 0.8746, lr_0 = 8.0910e-04
Loss = 9.0761e-02, PNorm = 140.9071, GNorm = 0.8811, lr_0 = 8.1045e-04
Validation auc = 0.734270
Epoch 480
Loss = 7.8188e-02, PNorm = 141.1659, GNorm = 1.9865, lr_0 = 8.1179e-04
Validation auc = 0.733718
Epoch 481
Loss = 4.9006e-02, PNorm = 141.3883, GNorm = 0.5193, lr_0 = 8.1314e-04
Validation auc = 0.736287
Epoch 482
Loss = 1.0088e-01, PNorm = 141.6033, GNorm = 0.7260, lr_0 = 8.1448e-04
Validation auc = 0.744827
Epoch 483
Loss = 6.8988e-02, PNorm = 141.8552, GNorm = 0.8433, lr_0 = 8.1583e-04
Validation auc = 0.714110
Epoch 484
Loss = 1.0989e-01, PNorm = 142.0735, GNorm = 1.1985, lr_0 = 8.1717e-04
Validation auc = 0.691415
Epoch 485
Loss = 6.7020e-02, PNorm = 142.3094, GNorm = 0.2797, lr_0 = 8.1852e-04
Validation auc = 0.710449
Epoch 486
Loss = 4.5967e-02, PNorm = 142.5718, GNorm = 1.5016, lr_0 = 8.1987e-04
Validation auc = 0.706315
Epoch 487
Loss = 4.9459e-02, PNorm = 142.8197, GNorm = 0.3404, lr_0 = 8.2121e-04
Validation auc = 0.748451
Epoch 488
Loss = 8.6426e-02, PNorm = 143.0195, GNorm = 1.4036, lr_0 = 8.2256e-04
Validation auc = 0.763333
Epoch 489
Loss = 1.5012e-01, PNorm = 143.1800, GNorm = 2.0898, lr_0 = 8.2390e-04
Loss = 1.0631e-01, PNorm = 143.3725, GNorm = 0.1593, lr_0 = 8.2525e-04
Validation auc = 0.719379
Epoch 490
Loss = 3.9567e-02, PNorm = 143.5859, GNorm = 0.9523, lr_0 = 8.2659e-04
Validation auc = 0.717879
Epoch 491
Loss = 7.2234e-02, PNorm = 143.7643, GNorm = 1.4884, lr_0 = 8.2794e-04
Validation auc = 0.751251
Epoch 492
Loss = 4.4913e-02, PNorm = 143.9631, GNorm = 1.8367, lr_0 = 8.2928e-04
Validation auc = 0.743196
Epoch 493
Loss = 6.3688e-02, PNorm = 144.1403, GNorm = 0.4061, lr_0 = 8.3063e-04
Validation auc = 0.743322
Epoch 494
Loss = 3.6903e-02, PNorm = 144.2964, GNorm = 0.2849, lr_0 = 8.3197e-04
Validation auc = 0.732347
Epoch 495
Loss = 6.0939e-02, PNorm = 144.4430, GNorm = 0.8333, lr_0 = 8.3332e-04
Validation auc = 0.751539
Epoch 496
Loss = 3.1119e-02, PNorm = 144.6108, GNorm = 1.8299, lr_0 = 8.3466e-04
Validation auc = 0.748757
Epoch 497
Loss = 8.3448e-03, PNorm = 144.7566, GNorm = 0.5674, lr_0 = 8.3601e-04
Validation auc = 0.737635
Epoch 498
Loss = 4.3853e-02, PNorm = 144.8886, GNorm = 0.8321, lr_0 = 8.3735e-04
Validation auc = 0.730780
Epoch 499
Loss = 4.0946e-02, PNorm = 145.0648, GNorm = 1.0863, lr_0 = 8.3870e-04
Loss = 8.6835e-02, PNorm = 145.2248, GNorm = 0.1306, lr_0 = 8.4004e-04
Validation auc = 0.755734
Epoch 500
Loss = 5.9982e-02, PNorm = 145.3906, GNorm = 3.8155, lr_0 = 8.4139e-04
Validation auc = 0.754638
Epoch 501
Loss = 3.6285e-02, PNorm = 145.5458, GNorm = 0.0830, lr_0 = 8.4274e-04
Validation auc = 0.723574
Epoch 502
Loss = 1.0128e-01, PNorm = 145.7183, GNorm = 2.0295, lr_0 = 8.4408e-04
Validation auc = 0.732063
Epoch 503
Loss = 6.9257e-02, PNorm = 145.9151, GNorm = 0.9272, lr_0 = 8.4543e-04
Validation auc = 0.737346
Epoch 504
Loss = 1.4392e-01, PNorm = 146.1232, GNorm = 2.3885, lr_0 = 8.4677e-04
Validation auc = 0.753902
Epoch 505
Loss = 6.2914e-02, PNorm = 146.3328, GNorm = 1.4464, lr_0 = 8.4812e-04
Validation auc = 0.755437
Epoch 506
Loss = 4.6614e-02, PNorm = 146.5364, GNorm = 1.7024, lr_0 = 8.4946e-04
Validation auc = 0.734864
Epoch 507
Loss = 7.8530e-02, PNorm = 146.7059, GNorm = 0.9232, lr_0 = 8.5081e-04
Validation auc = 0.736601
Epoch 508
Loss = 1.4949e-02, PNorm = 146.8563, GNorm = 0.2001, lr_0 = 8.5215e-04
Validation auc = 0.747335
Epoch 509
Loss = 4.4274e-02, PNorm = 146.9982, GNorm = 1.4431, lr_0 = 8.5350e-04
Loss = 3.1715e-02, PNorm = 147.1397, GNorm = 0.1042, lr_0 = 8.5484e-04
Validation auc = 0.747324
Epoch 510
Loss = 3.7802e-02, PNorm = 147.3008, GNorm = 0.1277, lr_0 = 8.5619e-04
Validation auc = 0.750461
Epoch 511
Loss = 6.8290e-03, PNorm = 147.4255, GNorm = 0.2220, lr_0 = 8.5753e-04
Validation auc = 0.740136
Epoch 512
Loss = 3.2799e-02, PNorm = 147.5252, GNorm = 3.4543, lr_0 = 8.5888e-04
Validation auc = 0.720681
Epoch 513
Loss = 4.2089e-02, PNorm = 147.6576, GNorm = 0.3375, lr_0 = 8.6022e-04
Validation auc = 0.715419
Epoch 514
Loss = 1.5615e-02, PNorm = 147.8412, GNorm = 0.7626, lr_0 = 8.6157e-04
Validation auc = 0.722226
Epoch 515
Loss = 7.8582e-02, PNorm = 148.0601, GNorm = 0.3297, lr_0 = 8.6291e-04
Validation auc = 0.742084
Epoch 516
Loss = 7.4090e-02, PNorm = 148.2878, GNorm = 0.9032, lr_0 = 8.6426e-04
Validation auc = 0.744967
Epoch 517
Loss = 3.2411e-02, PNorm = 148.4828, GNorm = 0.7020, lr_0 = 8.6561e-04
Validation auc = 0.754399
Epoch 518
Loss = 1.7490e-02, PNorm = 148.6583, GNorm = 0.2702, lr_0 = 8.6695e-04
Validation auc = 0.750703
Epoch 519
Loss = 1.8180e-02, PNorm = 148.8622, GNorm = 0.7576, lr_0 = 8.6830e-04
Loss = 5.1554e-02, PNorm = 149.0592, GNorm = 1.9048, lr_0 = 8.6964e-04
Validation auc = 0.759655
Epoch 520
Loss = 1.4044e-01, PNorm = 149.3573, GNorm = 2.4020, lr_0 = 8.7099e-04
Validation auc = 0.758546
Epoch 521
Loss = 7.1523e-02, PNorm = 149.7007, GNorm = 0.2127, lr_0 = 8.7233e-04
Validation auc = 0.760342
Epoch 522
Loss = 6.5418e-02, PNorm = 150.0174, GNorm = 0.3878, lr_0 = 8.7368e-04
Validation auc = 0.732196
Epoch 523
Loss = 9.3669e-02, PNorm = 150.3425, GNorm = 1.0692, lr_0 = 8.7502e-04
Validation auc = 0.731288
Epoch 524
Loss = 6.6633e-02, PNorm = 150.6517, GNorm = 1.3603, lr_0 = 8.7637e-04
Validation auc = 0.727119
Epoch 525
Loss = 9.9727e-02, PNorm = 150.9174, GNorm = 1.8807, lr_0 = 8.7771e-04
Validation auc = 0.730234
Epoch 526
Loss = 6.9036e-02, PNorm = 151.2205, GNorm = 1.7360, lr_0 = 8.7906e-04
Validation auc = 0.750525
Epoch 527
Loss = 4.7449e-02, PNorm = 151.5060, GNorm = 0.4885, lr_0 = 8.8040e-04
Validation auc = 0.736378
Epoch 528
Loss = 2.7247e-02, PNorm = 151.7609, GNorm = 1.1548, lr_0 = 8.8175e-04
Validation auc = 0.731289
Epoch 529
Loss = 4.8327e-02, PNorm = 151.9554, GNorm = 0.8228, lr_0 = 8.8309e-04
Loss = 4.6356e-02, PNorm = 152.1189, GNorm = 0.2167, lr_0 = 8.8444e-04
Validation auc = 0.726202
Epoch 530
Loss = 7.9256e-02, PNorm = 152.2993, GNorm = 2.0249, lr_0 = 8.8578e-04
Validation auc = 0.729714
Epoch 531
Loss = 7.7319e-02, PNorm = 152.5166, GNorm = 2.1390, lr_0 = 8.8713e-04
Validation auc = 0.713929
Epoch 532
Loss = 5.9030e-02, PNorm = 152.7854, GNorm = 0.8622, lr_0 = 8.8848e-04
Validation auc = 0.703433
Epoch 533
Loss = 6.1076e-02, PNorm = 153.0715, GNorm = 0.3897, lr_0 = 8.8982e-04
Validation auc = 0.705415
Epoch 534
Loss = 7.3871e-02, PNorm = 153.3304, GNorm = 2.3307, lr_0 = 8.9117e-04
Validation auc = 0.725373
Epoch 535
Loss = 4.9895e-02, PNorm = 153.6117, GNorm = 1.7630, lr_0 = 8.9251e-04
Validation auc = 0.728148
Epoch 536
Loss = 2.0739e-02, PNorm = 153.9353, GNorm = 0.3171, lr_0 = 8.9386e-04
Validation auc = 0.702227
Epoch 537
Loss = 8.6431e-02, PNorm = 154.1847, GNorm = 2.6438, lr_0 = 8.9520e-04
Validation auc = 0.710215
Epoch 538
Loss = 5.3860e-02, PNorm = 154.4096, GNorm = 1.8137, lr_0 = 8.9655e-04
Validation auc = 0.710906
Epoch 539
Loss = 1.8606e-02, PNorm = 154.6380, GNorm = 0.5072, lr_0 = 8.9789e-04
Loss = 1.0768e-01, PNorm = 154.9160, GNorm = 2.0011, lr_0 = 8.9924e-04
Validation auc = 0.731721
Epoch 540
Loss = 3.4371e-02, PNorm = 155.1903, GNorm = 0.8939, lr_0 = 9.0058e-04
Validation auc = 0.716928
Epoch 541
Loss = 8.1341e-02, PNorm = 155.3920, GNorm = 1.7566, lr_0 = 9.0193e-04
Validation auc = 0.710443
Epoch 542
Loss = 7.9694e-02, PNorm = 155.6227, GNorm = 1.3979, lr_0 = 9.0327e-04
Validation auc = 0.732888
Epoch 543
Loss = 8.7485e-02, PNorm = 155.9062, GNorm = 0.5648, lr_0 = 9.0462e-04
Validation auc = 0.730535
Epoch 544
Loss = 9.1953e-02, PNorm = 156.1967, GNorm = 2.8345, lr_0 = 9.0596e-04
Validation auc = 0.740890
Epoch 545
Loss = 4.2089e-02, PNorm = 156.5160, GNorm = 3.3772, lr_0 = 9.0731e-04
Validation auc = 0.732574
Epoch 546
Loss = 1.3224e-01, PNorm = 156.8134, GNorm = 2.4937, lr_0 = 9.0865e-04
Validation auc = 0.740597
Epoch 547
Loss = 3.5966e-02, PNorm = 157.1646, GNorm = 0.2720, lr_0 = 9.1000e-04
Validation auc = 0.717985
Epoch 548
Loss = 1.1396e-01, PNorm = 157.4707, GNorm = 1.5584, lr_0 = 9.1135e-04
Validation auc = 0.739257
Epoch 549
Loss = 1.1916e-01, PNorm = 157.7451, GNorm = 2.8223, lr_0 = 9.1269e-04
Loss = 6.4884e-02, PNorm = 158.0398, GNorm = 2.1342, lr_0 = 9.1404e-04
Validation auc = 0.707114
Epoch 550
Loss = 7.5434e-02, PNorm = 158.3472, GNorm = 1.8279, lr_0 = 9.1538e-04
Validation auc = 0.710823
Epoch 551
Loss = 1.0067e-01, PNorm = 158.6530, GNorm = 3.5595, lr_0 = 9.1673e-04
Validation auc = 0.720791
Epoch 552
Loss = 1.1525e-01, PNorm = 159.0109, GNorm = 1.4101, lr_0 = 9.1807e-04
Validation auc = 0.728308
Epoch 553
Loss = 4.6829e-02, PNorm = 159.3713, GNorm = 0.7863, lr_0 = 9.1942e-04
Validation auc = 0.727633
Epoch 554
Loss = 8.4751e-02, PNorm = 159.6457, GNorm = 1.4884, lr_0 = 9.2076e-04
Validation auc = 0.743036
Epoch 555
Loss = 9.6622e-02, PNorm = 159.9610, GNorm = 0.7891, lr_0 = 9.2211e-04
Validation auc = 0.731870
Epoch 556
Loss = 9.5381e-02, PNorm = 160.2940, GNorm = 3.3668, lr_0 = 9.2345e-04
Validation auc = 0.718289
Epoch 557
Loss = 9.5341e-02, PNorm = 160.5773, GNorm = 1.3091, lr_0 = 9.2480e-04
Validation auc = 0.740883
Epoch 558
Loss = 1.9005e-02, PNorm = 160.8494, GNorm = 0.1485, lr_0 = 9.2614e-04
Validation auc = 0.727530
Epoch 559
Loss = 1.0802e-01, PNorm = 161.0947, GNorm = 2.3961, lr_0 = 9.2749e-04
Loss = 2.8146e-02, PNorm = 161.3172, GNorm = 0.1480, lr_0 = 9.2883e-04
Validation auc = 0.738119
Epoch 560
Loss = 4.2447e-02, PNorm = 161.4735, GNorm = 1.3766, lr_0 = 9.3018e-04
Validation auc = 0.742672
Epoch 561
Loss = 6.2217e-02, PNorm = 161.6677, GNorm = 1.0567, lr_0 = 9.3152e-04
Validation auc = 0.760347
Epoch 562
Loss = 1.2862e-01, PNorm = 161.9148, GNorm = 1.7435, lr_0 = 9.3287e-04
Validation auc = 0.747981
Epoch 563
Loss = 9.1900e-02, PNorm = 162.2229, GNorm = 2.1451, lr_0 = 9.3422e-04
Validation auc = 0.724020
Epoch 564
Loss = 5.9216e-02, PNorm = 162.5432, GNorm = 0.3721, lr_0 = 9.3556e-04
Validation auc = 0.737681
Epoch 565
Loss = 4.9519e-02, PNorm = 162.8447, GNorm = 0.5511, lr_0 = 9.3691e-04
Validation auc = 0.725208
Epoch 566
Loss = 4.7101e-02, PNorm = 163.0726, GNorm = 1.0113, lr_0 = 9.3825e-04
Validation auc = 0.731683
Epoch 567
Loss = 1.8229e-01, PNorm = 163.2882, GNorm = 0.5396, lr_0 = 9.3960e-04
Validation auc = 0.717895
Epoch 568
Loss = 2.5717e-02, PNorm = 163.5135, GNorm = 0.4774, lr_0 = 9.4094e-04
Validation auc = 0.732196
Epoch 569
Loss = 5.5278e-03, PNorm = 163.6924, GNorm = 0.1698, lr_0 = 9.4229e-04
Loss = 3.4279e-02, PNorm = 163.8839, GNorm = 0.3222, lr_0 = 9.4363e-04
Validation auc = 0.742115
Epoch 570
Loss = 4.1495e-02, PNorm = 164.0628, GNorm = 0.1579, lr_0 = 9.4498e-04
Validation auc = 0.740383
Epoch 571
Loss = 9.1516e-02, PNorm = 164.2577, GNorm = 4.8266, lr_0 = 9.4632e-04
Validation auc = 0.737413
Epoch 572
Loss = 1.2605e-01, PNorm = 164.6004, GNorm = 3.1565, lr_0 = 9.4767e-04
Validation auc = 0.760393
Epoch 573
Loss = 1.0056e-01, PNorm = 165.0411, GNorm = 1.8534, lr_0 = 9.4901e-04
Validation auc = 0.736791
Epoch 574
Loss = 8.0633e-02, PNorm = 165.4025, GNorm = 0.3657, lr_0 = 9.5036e-04
Validation auc = 0.741680
Epoch 575
Loss = 3.4064e-02, PNorm = 165.6850, GNorm = 0.5336, lr_0 = 9.5170e-04
Validation auc = 0.744339
Epoch 576
Loss = 8.8962e-02, PNorm = 165.8985, GNorm = 0.1311, lr_0 = 9.5305e-04
Validation auc = 0.742244
Epoch 577
Loss = 3.4323e-02, PNorm = 166.1372, GNorm = 0.7973, lr_0 = 9.5439e-04
Validation auc = 0.762641
Epoch 578
Loss = 5.2793e-02, PNorm = 166.4709, GNorm = 0.6723, lr_0 = 9.5574e-04
Validation auc = 0.761516
Epoch 579
Loss = 4.0865e-02, PNorm = 166.7717, GNorm = 0.7282, lr_0 = 9.5709e-04
Loss = 5.5136e-02, PNorm = 166.9938, GNorm = 0.2905, lr_0 = 9.5843e-04
Validation auc = 0.721394
Epoch 580
Loss = 1.1475e-01, PNorm = 167.1926, GNorm = 5.9170, lr_0 = 9.5978e-04
Validation auc = 0.743187
Epoch 581
Loss = 1.4575e-01, PNorm = 167.5014, GNorm = 3.8711, lr_0 = 9.6112e-04
Validation auc = 0.756790
Epoch 582
Loss = 9.7764e-02, PNorm = 167.8876, GNorm = 0.5934, lr_0 = 9.6247e-04
Validation auc = 0.764982
Epoch 583
Loss = 5.2948e-02, PNorm = 168.2680, GNorm = 0.5601, lr_0 = 9.6381e-04
Validation auc = 0.728901
Epoch 584
Loss = 9.3505e-02, PNorm = 168.5979, GNorm = 1.0639, lr_0 = 9.6516e-04
Validation auc = 0.762035
Epoch 585
Loss = 5.0652e-02, PNorm = 168.8704, GNorm = 1.0641, lr_0 = 9.6650e-04
Validation auc = 0.737756
Epoch 586
Loss = 1.0281e-01, PNorm = 169.1596, GNorm = 0.7637, lr_0 = 9.6785e-04
Validation auc = 0.722794
Epoch 587
Loss = 1.1322e-01, PNorm = 169.5086, GNorm = 3.1755, lr_0 = 9.6919e-04
Validation auc = 0.760212
Epoch 588
Loss = 5.0940e-02, PNorm = 169.8225, GNorm = 1.1611, lr_0 = 9.7054e-04
Validation auc = 0.763476
Epoch 589
Loss = 8.2396e-02, PNorm = 170.0882, GNorm = 1.7732, lr_0 = 9.7188e-04
Loss = 9.5478e-02, PNorm = 170.3123, GNorm = 1.1992, lr_0 = 9.7323e-04
Validation auc = 0.746560
Epoch 590
Loss = 6.9605e-02, PNorm = 170.5335, GNorm = 2.0117, lr_0 = 9.7457e-04
Validation auc = 0.745747
Epoch 591
Loss = 5.1046e-02, PNorm = 170.7694, GNorm = 3.4041, lr_0 = 9.7592e-04
Validation auc = 0.774255
Epoch 592
Loss = 6.5566e-02, PNorm = 171.0002, GNorm = 0.6816, lr_0 = 9.7726e-04
Validation auc = 0.781210
Epoch 593
Loss = 4.2960e-02, PNorm = 171.2086, GNorm = 1.8716, lr_0 = 9.7861e-04
Validation auc = 0.766137
Epoch 594
Loss = 8.2282e-02, PNorm = 171.3759, GNorm = 2.8585, lr_0 = 9.7996e-04
Validation auc = 0.741773
Epoch 595
Loss = 4.6918e-02, PNorm = 171.5815, GNorm = 2.8969, lr_0 = 9.8130e-04
Validation auc = 0.755011
Epoch 596
Loss = 1.3027e-01, PNorm = 171.8674, GNorm = 1.7925, lr_0 = 9.8265e-04
Validation auc = 0.731574
Epoch 597
Loss = 3.6342e-02, PNorm = 172.1853, GNorm = 0.9181, lr_0 = 9.8399e-04
Validation auc = 0.757725
Epoch 598
Loss = 3.2264e-02, PNorm = 172.4705, GNorm = 0.8151, lr_0 = 9.8534e-04
Validation auc = 0.775147
Epoch 599
Loss = 1.9779e-02, PNorm = 172.7178, GNorm = 0.5347, lr_0 = 9.8668e-04
Loss = 5.1096e-02, PNorm = 172.9140, GNorm = 0.2228, lr_0 = 9.8803e-04
Validation auc = 0.739074
Epoch 600
Loss = 6.2278e-02, PNorm = 173.1087, GNorm = 0.7344, lr_0 = 9.8937e-04
Validation auc = 0.741367
Epoch 601
Loss = 6.2422e-02, PNorm = 173.3306, GNorm = 1.8360, lr_0 = 9.9072e-04
Validation auc = 0.737448
Epoch 602
Loss = 1.2191e-01, PNorm = 173.5938, GNorm = 2.3024, lr_0 = 9.9206e-04
Validation auc = 0.735110
Epoch 603
Loss = 9.4224e-02, PNorm = 173.9045, GNorm = 1.1576, lr_0 = 9.9341e-04
Validation auc = 0.742213
Epoch 604
Loss = 5.2769e-02, PNorm = 174.2133, GNorm = 0.7591, lr_0 = 9.9475e-04
Validation auc = 0.751323
Epoch 605
Loss = 5.0169e-02, PNorm = 174.4519, GNorm = 1.0705, lr_0 = 9.9610e-04
Validation auc = 0.753769
Epoch 606
Loss = 1.9831e-02, PNorm = 174.6588, GNorm = 0.4570, lr_0 = 9.9744e-04
Validation auc = 0.734974
Epoch 607
Loss = 1.6484e-02, PNorm = 174.8225, GNorm = 0.1754, lr_0 = 9.9879e-04
Validation auc = 0.732503
Epoch 608
Loss = 8.4409e-02, PNorm = 175.0212, GNorm = 1.8936, lr_0 = 1.0000e-03
Validation auc = 0.708075
Epoch 609
Loss = 8.3987e-03, PNorm = 175.3545, GNorm = 0.3399, lr_0 = 1.0000e-03
Loss = 3.1154e-02, PNorm = 175.6625, GNorm = 1.9314, lr_0 = 1.0000e-03
Validation auc = 0.708526
Epoch 610
Loss = 4.5232e-02, PNorm = 175.9029, GNorm = 0.8112, lr_0 = 1.0000e-03
Validation auc = 0.703772
Epoch 611
Loss = 6.6251e-02, PNorm = 176.1452, GNorm = 1.4143, lr_0 = 1.0000e-03
Validation auc = 0.740348
Epoch 612
Loss = 3.8566e-02, PNorm = 176.3739, GNorm = 1.0162, lr_0 = 1.0000e-03
Validation auc = 0.728461
Epoch 613
Loss = 7.3796e-02, PNorm = 176.5827, GNorm = 0.5044, lr_0 = 1.0000e-03
Validation auc = 0.726105
Epoch 614
Loss = 4.3376e-02, PNorm = 176.7874, GNorm = 0.8051, lr_0 = 1.0000e-03
Validation auc = 0.726354
Epoch 615
Loss = 6.7728e-02, PNorm = 177.0116, GNorm = 3.6223, lr_0 = 9.9999e-04
Validation auc = 0.726127
Epoch 616
Loss = 1.1497e-01, PNorm = 177.3177, GNorm = 1.1490, lr_0 = 9.9999e-04
Validation auc = 0.723282
Epoch 617
Loss = 8.0710e-02, PNorm = 177.6532, GNorm = 0.4251, lr_0 = 9.9999e-04
Validation auc = 0.716860
Epoch 618
Loss = 7.6183e-02, PNorm = 177.9703, GNorm = 0.5198, lr_0 = 9.9999e-04
Validation auc = 0.698411
Epoch 619
Loss = 1.8707e-02, PNorm = 178.2375, GNorm = 0.8413, lr_0 = 9.9999e-04
Loss = 9.0050e-02, PNorm = 178.5112, GNorm = 0.8015, lr_0 = 9.9999e-04
Validation auc = 0.712720
Epoch 620
Loss = 5.8458e-02, PNorm = 178.8149, GNorm = 1.1133, lr_0 = 9.9999e-04
Validation auc = 0.723546
Epoch 621
Loss = 1.2394e-01, PNorm = 179.0524, GNorm = 2.2154, lr_0 = 9.9999e-04
Validation auc = 0.720117
Epoch 622
Loss = 7.0229e-02, PNorm = 179.3569, GNorm = 2.4470, lr_0 = 9.9999e-04
Validation auc = 0.716534
Epoch 623
Loss = 5.2383e-02, PNorm = 179.6488, GNorm = 1.7541, lr_0 = 9.9999e-04
Validation auc = 0.710181
Epoch 624
Loss = 7.8865e-02, PNorm = 179.8758, GNorm = 1.8026, lr_0 = 9.9999e-04
Validation auc = 0.727752
Epoch 625
Loss = 7.0296e-02, PNorm = 180.1111, GNorm = 1.8338, lr_0 = 9.9999e-04
Validation auc = 0.716144
Epoch 626
Loss = 1.1636e-01, PNorm = 180.3954, GNorm = 1.2394, lr_0 = 9.9999e-04
Validation auc = 0.701347
Epoch 627
Loss = 1.2888e-01, PNorm = 180.6974, GNorm = 0.6264, lr_0 = 9.9999e-04
Validation auc = 0.730506
Epoch 628
Loss = 5.2550e-02, PNorm = 181.0520, GNorm = 0.9371, lr_0 = 9.9998e-04
Validation auc = 0.734769
Epoch 629
Loss = 3.9817e-03, PNorm = 181.3640, GNorm = 0.1071, lr_0 = 9.9998e-04
Loss = 7.6433e-02, PNorm = 181.6167, GNorm = 2.6091, lr_0 = 9.9998e-04
Validation auc = 0.742945
Epoch 630
Loss = 8.1994e-02, PNorm = 181.8697, GNorm = 1.0449, lr_0 = 9.9998e-04
Validation auc = 0.730697
Epoch 631
Loss = 4.1447e-02, PNorm = 182.1036, GNorm = 0.1281, lr_0 = 9.9998e-04
Validation auc = 0.702452
Epoch 632
Loss = 9.5347e-02, PNorm = 182.3532, GNorm = 2.4932, lr_0 = 9.9998e-04
Validation auc = 0.712302
Epoch 633
Loss = 9.2462e-02, PNorm = 182.6632, GNorm = 1.1596, lr_0 = 9.9998e-04
Validation auc = 0.729851
Epoch 634
Loss = 7.7856e-02, PNorm = 182.9977, GNorm = 0.2504, lr_0 = 9.9998e-04
Validation auc = 0.750567
Epoch 635
Loss = 1.2551e-01, PNorm = 183.3284, GNorm = 2.1623, lr_0 = 9.9998e-04
Validation auc = 0.713862
Epoch 636
Loss = 6.6921e-02, PNorm = 183.6204, GNorm = 1.3920, lr_0 = 9.9998e-04
Validation auc = 0.697984
Epoch 637
Loss = 4.0563e-02, PNorm = 183.8366, GNorm = 2.6289, lr_0 = 9.9998e-04
Validation auc = 0.704898
Epoch 638
Loss = 9.6669e-02, PNorm = 184.0143, GNorm = 2.0482, lr_0 = 9.9998e-04
Validation auc = 0.706698
Epoch 639
Loss = 1.9341e-02, PNorm = 184.2177, GNorm = 0.8301, lr_0 = 9.9998e-04
Loss = 6.7290e-02, PNorm = 184.4256, GNorm = 3.8209, lr_0 = 9.9998e-04
Validation auc = 0.713986
Epoch 640
Loss = 7.2844e-02, PNorm = 184.6653, GNorm = 0.1737, lr_0 = 9.9998e-04
Validation auc = 0.728183
Epoch 641
Loss = 3.8214e-02, PNorm = 184.8824, GNorm = 0.2079, lr_0 = 9.9997e-04
Validation auc = 0.740612
Epoch 642
Loss = 2.7657e-02, PNorm = 185.0600, GNorm = 1.3652, lr_0 = 9.9997e-04
Validation auc = 0.741689
Epoch 643
Loss = 6.7791e-02, PNorm = 185.2277, GNorm = 1.4192, lr_0 = 9.9997e-04
Validation auc = 0.723491
Epoch 644
Loss = 6.8979e-02, PNorm = 185.4075, GNorm = 1.9108, lr_0 = 9.9997e-04
Validation auc = 0.719439
Epoch 645
Loss = 8.2612e-02, PNorm = 185.5825, GNorm = 1.3814, lr_0 = 9.9997e-04
Validation auc = 0.718536
Epoch 646
Loss = 4.3295e-02, PNorm = 185.7510, GNorm = 0.9596, lr_0 = 9.9997e-04
Validation auc = 0.736349
Epoch 647
Loss = 7.6241e-02, PNorm = 185.9308, GNorm = 1.1558, lr_0 = 9.9997e-04
Validation auc = 0.752110
Epoch 648
Loss = 1.4449e-02, PNorm = 186.1531, GNorm = 0.1303, lr_0 = 9.9997e-04
Validation auc = 0.722404
Epoch 649
Loss = 2.1008e-02, PNorm = 186.3837, GNorm = 0.4268, lr_0 = 9.9997e-04
Loss = 4.2062e-02, PNorm = 186.5867, GNorm = 1.8372, lr_0 = 9.9997e-04
Validation auc = 0.725058
Epoch 650
Loss = 3.7747e-02, PNorm = 186.7860, GNorm = 0.6424, lr_0 = 9.9997e-04
Validation auc = 0.728820
Epoch 651
Loss = 4.7674e-02, PNorm = 186.9535, GNorm = 2.2015, lr_0 = 9.9997e-04
Validation auc = 0.761591
Epoch 652
Loss = 1.4995e-02, PNorm = 187.2119, GNorm = 0.6063, lr_0 = 9.9997e-04
Validation auc = 0.746713
Epoch 653
Loss = 4.0742e-02, PNorm = 187.4755, GNorm = 1.1558, lr_0 = 9.9997e-04
Validation auc = 0.730797
Epoch 654
Loss = 4.5513e-02, PNorm = 187.7357, GNorm = 0.8367, lr_0 = 9.9996e-04
Validation auc = 0.730183
Epoch 655
Loss = 7.4062e-02, PNorm = 188.0416, GNorm = 0.4019, lr_0 = 9.9996e-04
Validation auc = 0.751613
Epoch 656
Loss = 6.0453e-02, PNorm = 188.3574, GNorm = 1.4784, lr_0 = 9.9996e-04
Validation auc = 0.722674
Epoch 657
Loss = 2.7484e-02, PNorm = 188.6274, GNorm = 1.6421, lr_0 = 9.9996e-04
Validation auc = 0.731743
Epoch 658
Loss = 1.2842e-01, PNorm = 188.9065, GNorm = 4.8552, lr_0 = 9.9996e-04
Validation auc = 0.743723
Epoch 659
Loss = 3.3358e-02, PNorm = 189.3107, GNorm = 0.6119, lr_0 = 9.9996e-04
Loss = 7.5173e-02, PNorm = 189.6834, GNorm = 0.1895, lr_0 = 9.9996e-04
Validation auc = 0.738629
Epoch 660
Loss = 8.7595e-02, PNorm = 189.9975, GNorm = 1.2474, lr_0 = 9.9996e-04
Validation auc = 0.746249
Epoch 661
Loss = 7.3178e-02, PNorm = 190.2741, GNorm = 1.2602, lr_0 = 9.9996e-04
Validation auc = 0.738767
Epoch 662
Loss = 9.5608e-02, PNorm = 190.5403, GNorm = 3.1807, lr_0 = 9.9996e-04
Validation auc = 0.754669
Epoch 663
Loss = 3.5429e-02, PNorm = 190.8224, GNorm = 1.3871, lr_0 = 9.9996e-04
Validation auc = 0.751930
Epoch 664
Loss = 6.7095e-02, PNorm = 191.0568, GNorm = 1.6311, lr_0 = 9.9996e-04
Validation auc = 0.726065
Epoch 665
Loss = 6.2083e-02, PNorm = 191.3225, GNorm = 0.1927, lr_0 = 9.9996e-04
Validation auc = 0.765911
Epoch 666
Loss = 5.2510e-02, PNorm = 191.6181, GNorm = 1.2826, lr_0 = 9.9996e-04
Validation auc = 0.753325
Epoch 667
Loss = 2.3867e-02, PNorm = 191.8884, GNorm = 0.1373, lr_0 = 9.9996e-04
Validation auc = 0.750026
Epoch 668
Loss = 2.5357e-02, PNorm = 192.1530, GNorm = 1.4594, lr_0 = 9.9995e-04
Validation auc = 0.730446
Epoch 669
Loss = 1.0652e-02, PNorm = 192.4780, GNorm = 0.3129, lr_0 = 9.9995e-04
Loss = 7.4978e-02, PNorm = 192.8069, GNorm = 1.0264, lr_0 = 9.9995e-04
Validation auc = 0.732905
Epoch 670
Loss = 1.0477e-01, PNorm = 193.1204, GNorm = 0.7135, lr_0 = 9.9995e-04
Validation auc = 0.707799
Epoch 671
Loss = 8.1748e-02, PNorm = 193.4338, GNorm = 1.7514, lr_0 = 9.9995e-04
Validation auc = 0.706321
Epoch 672
Loss = 3.2393e-02, PNorm = 193.7166, GNorm = 0.2693, lr_0 = 9.9995e-04
Validation auc = 0.699145
Epoch 673
Loss = 5.1381e-02, PNorm = 193.9321, GNorm = 2.3050, lr_0 = 9.9995e-04
Validation auc = 0.725128
Epoch 674
Loss = 8.1101e-02, PNorm = 194.1082, GNorm = 2.7605, lr_0 = 9.9995e-04
Validation auc = 0.733692
Epoch 675
Loss = 3.3056e-02, PNorm = 194.2783, GNorm = 0.2654, lr_0 = 9.9995e-04
Validation auc = 0.746176
Epoch 676
Loss = 1.9659e-02, PNorm = 194.4660, GNorm = 0.2752, lr_0 = 9.9995e-04
Validation auc = 0.720401
Epoch 677
Loss = 3.3592e-02, PNorm = 194.6214, GNorm = 0.1249, lr_0 = 9.9995e-04
Validation auc = 0.720474
Epoch 678
Loss = 1.7533e-02, PNorm = 194.7640, GNorm = 0.2646, lr_0 = 9.9995e-04
Validation auc = 0.736169
Epoch 679
Loss = 8.9968e-02, PNorm = 194.9101, GNorm = 1.9300, lr_0 = 9.9995e-04
Loss = 2.5577e-02, PNorm = 195.0773, GNorm = 0.2360, lr_0 = 9.9995e-04
Validation auc = 0.725181
Epoch 680
Loss = 4.9024e-02, PNorm = 195.2424, GNorm = 0.5614, lr_0 = 9.9994e-04
Validation auc = 0.726691
Epoch 681
Loss = 3.4614e-02, PNorm = 195.4038, GNorm = 0.4970, lr_0 = 9.9994e-04
Validation auc = 0.739580
Epoch 682
Loss = 5.8007e-02, PNorm = 195.5576, GNorm = 0.6495, lr_0 = 9.9994e-04
Validation auc = 0.739137
Epoch 683
Loss = 3.1635e-02, PNorm = 195.7107, GNorm = 0.9252, lr_0 = 9.9994e-04
Validation auc = 0.737529
Epoch 684
Loss = 5.3389e-02, PNorm = 195.8718, GNorm = 1.9093, lr_0 = 9.9994e-04
Validation auc = 0.717273
Epoch 685
Loss = 2.9652e-02, PNorm = 196.0895, GNorm = 0.0782, lr_0 = 9.9994e-04
Validation auc = 0.735651
Epoch 686
Loss = 4.7699e-02, PNorm = 196.2742, GNorm = 1.2620, lr_0 = 9.9994e-04
Validation auc = 0.744245
Epoch 687
Loss = 8.1401e-02, PNorm = 196.4686, GNorm = 1.4308, lr_0 = 9.9994e-04
Validation auc = 0.726928
Epoch 688
Loss = 9.5370e-02, PNorm = 196.6593, GNorm = 2.6565, lr_0 = 9.9994e-04
Validation auc = 0.710575
Epoch 689
Loss = 7.5319e-02, PNorm = 196.8779, GNorm = 1.0367, lr_0 = 9.9994e-04
Loss = 3.5294e-02, PNorm = 197.0839, GNorm = 0.1902, lr_0 = 9.9994e-04
Validation auc = 0.721264
Epoch 690
Loss = 5.2062e-02, PNorm = 197.2717, GNorm = 0.2785, lr_0 = 9.9994e-04
Validation auc = 0.714801
Epoch 691
Loss = 7.9048e-02, PNorm = 197.5024, GNorm = 0.6981, lr_0 = 9.9994e-04
Validation auc = 0.711641
Epoch 692
Loss = 5.4540e-02, PNorm = 197.7298, GNorm = 1.7814, lr_0 = 9.9994e-04
Validation auc = 0.707416
Epoch 693
Loss = 2.3701e-02, PNorm = 197.9480, GNorm = 1.4952, lr_0 = 9.9994e-04
Validation auc = 0.714721
Epoch 694
Loss = 4.9478e-02, PNorm = 198.1446, GNorm = 0.2339, lr_0 = 9.9993e-04
Validation auc = 0.704721
Epoch 695
Loss = 3.4060e-02, PNorm = 198.3629, GNorm = 0.9898, lr_0 = 9.9993e-04
Validation auc = 0.716732
Epoch 696
Loss = 8.3328e-02, PNorm = 198.5680, GNorm = 4.0647, lr_0 = 9.9993e-04
Validation auc = 0.742679
Epoch 697
Loss = 8.2414e-02, PNorm = 198.7861, GNorm = 1.8480, lr_0 = 9.9993e-04
Validation auc = 0.723220
Epoch 698
Loss = 5.8674e-02, PNorm = 199.0448, GNorm = 1.4077, lr_0 = 9.9993e-04
Validation auc = 0.731766
Epoch 699
Loss = 4.7382e-02, PNorm = 199.3438, GNorm = 1.5499, lr_0 = 9.9993e-04
Loss = 8.2283e-02, PNorm = 199.5930, GNorm = 0.4985, lr_0 = 9.9993e-04
Validation auc = 0.748251
Epoch 700
Loss = 5.3375e-02, PNorm = 199.8111, GNorm = 1.1276, lr_0 = 9.9993e-04
Validation auc = 0.743463
Epoch 701
Loss = 7.7558e-02, PNorm = 200.0149, GNorm = 0.6642, lr_0 = 9.9993e-04
Validation auc = 0.738669
Epoch 702
Loss = 3.2781e-02, PNorm = 200.2704, GNorm = 2.1614, lr_0 = 9.9993e-04
Validation auc = 0.714248
Epoch 703
Loss = 2.2363e-02, PNorm = 200.5062, GNorm = 0.7126, lr_0 = 9.9993e-04
Validation auc = 0.738693
Epoch 704
Loss = 1.0516e-01, PNorm = 200.7259, GNorm = 0.5206, lr_0 = 9.9993e-04
Validation auc = 0.737148
Epoch 705
Loss = 6.8335e-02, PNorm = 201.0159, GNorm = 0.2071, lr_0 = 9.9993e-04
Validation auc = 0.757512
Epoch 706
Loss = 6.8210e-02, PNorm = 201.3084, GNorm = 0.7427, lr_0 = 9.9993e-04
Validation auc = 0.778650
Epoch 707
Loss = 7.3031e-02, PNorm = 201.5898, GNorm = 1.0830, lr_0 = 9.9992e-04
Validation auc = 0.764330
Epoch 708
Loss = 5.9157e-02, PNorm = 201.8227, GNorm = 0.0726, lr_0 = 9.9992e-04
Validation auc = 0.736688
Epoch 709
Loss = 4.4370e-02, PNorm = 202.0778, GNorm = 0.7745, lr_0 = 9.9992e-04
Loss = 4.0980e-02, PNorm = 202.3094, GNorm = 1.6893, lr_0 = 9.9992e-04
Validation auc = 0.728500
Epoch 710
Loss = 2.7412e-02, PNorm = 202.4980, GNorm = 0.8046, lr_0 = 9.9992e-04
Validation auc = 0.737748
Epoch 711
Loss = 6.8506e-02, PNorm = 202.6946, GNorm = 0.7533, lr_0 = 9.9992e-04
Validation auc = 0.711481
Epoch 712
Loss = 8.6090e-02, PNorm = 202.9347, GNorm = 1.5204, lr_0 = 9.9992e-04
Validation auc = 0.730293
Epoch 713
Loss = 1.7136e-01, PNorm = 203.1980, GNorm = 6.1362, lr_0 = 9.9992e-04
Validation auc = 0.715337
Epoch 714
Loss = 7.5542e-02, PNorm = 203.4973, GNorm = 1.0988, lr_0 = 9.9992e-04
Validation auc = 0.729254
Epoch 715
Loss = 4.1131e-02, PNorm = 203.7495, GNorm = 1.1852, lr_0 = 9.9992e-04
Validation auc = 0.746100
Epoch 716
Loss = 4.0630e-02, PNorm = 203.9203, GNorm = 2.2225, lr_0 = 9.9992e-04
Validation auc = 0.745063
Epoch 717
Loss = 1.2996e-01, PNorm = 204.0688, GNorm = 0.7417, lr_0 = 9.9992e-04
Validation auc = 0.726617
Epoch 718
Loss = 9.0589e-02, PNorm = 204.2451, GNorm = 2.1741, lr_0 = 9.9992e-04
Validation auc = 0.724354
Epoch 719
Loss = 1.8644e-02, PNorm = 204.4792, GNorm = 0.4790, lr_0 = 9.9992e-04
Loss = 5.9713e-02, PNorm = 204.6914, GNorm = 5.1854, lr_0 = 9.9992e-04
Validation auc = 0.720472
Epoch 720
Loss = 4.4619e-02, PNorm = 204.9172, GNorm = 1.0685, lr_0 = 9.9991e-04
Validation auc = 0.718140
Epoch 721
Loss = 7.8314e-02, PNorm = 205.1409, GNorm = 2.5186, lr_0 = 9.9991e-04
Validation auc = 0.709276
Epoch 722
Loss = 3.6005e-02, PNorm = 205.3577, GNorm = 0.1409, lr_0 = 9.9991e-04
Validation auc = 0.736831
Epoch 723
Loss = 5.5563e-02, PNorm = 205.5400, GNorm = 2.0636, lr_0 = 9.9991e-04
Validation auc = 0.706982
Epoch 724
Loss = 5.7869e-02, PNorm = 205.7377, GNorm = 0.2303, lr_0 = 9.9991e-04
Validation auc = 0.709116
Epoch 725
Loss = 6.0920e-02, PNorm = 205.9657, GNorm = 2.9696, lr_0 = 9.9991e-04
Validation auc = 0.725799
Epoch 726
Loss = 1.7373e-02, PNorm = 206.1530, GNorm = 2.4386, lr_0 = 9.9991e-04
Validation auc = 0.735217
Epoch 727
Loss = 2.2344e-02, PNorm = 206.3122, GNorm = 1.1295, lr_0 = 9.9991e-04
Validation auc = 0.732064
Epoch 728
Loss = 1.5348e-01, PNorm = 206.4671, GNorm = 2.6966, lr_0 = 9.9991e-04
Validation auc = 0.726099
Epoch 729
Loss = 1.2709e-01, PNorm = 206.7001, GNorm = 0.8358, lr_0 = 9.9991e-04
Loss = 8.9788e-02, PNorm = 206.9699, GNorm = 3.1568, lr_0 = 9.9991e-04
Validation auc = 0.750720
Epoch 730
Loss = 3.1299e-02, PNorm = 207.2814, GNorm = 3.3805, lr_0 = 9.9991e-04
Validation auc = 0.744129
Epoch 731
Loss = 3.0305e-02, PNorm = 207.5210, GNorm = 1.7392, lr_0 = 9.9991e-04
Validation auc = 0.733136
Epoch 732
Loss = 5.3856e-02, PNorm = 207.7007, GNorm = 0.9412, lr_0 = 9.9991e-04
Validation auc = 0.728881
Epoch 733
Loss = 4.8716e-02, PNorm = 207.8819, GNorm = 0.7315, lr_0 = 9.9990e-04
Validation auc = 0.727897
Epoch 734
Loss = 3.7551e-02, PNorm = 208.0778, GNorm = 0.7814, lr_0 = 9.9990e-04
Validation auc = 0.725457
Epoch 735
Loss = 3.4745e-02, PNorm = 208.2725, GNorm = 2.2600, lr_0 = 9.9990e-04
Validation auc = 0.723556
Epoch 736
Loss = 1.6670e-01, PNorm = 208.5288, GNorm = 0.1790, lr_0 = 9.9990e-04
Validation auc = 0.759303
Epoch 737
Loss = 3.7684e-02, PNorm = 208.9195, GNorm = 1.6291, lr_0 = 9.9990e-04
Validation auc = 0.747938
Epoch 738
Loss = 8.5529e-02, PNorm = 209.3020, GNorm = 2.5137, lr_0 = 9.9990e-04
Validation auc = 0.735463
Epoch 739
Loss = 3.0331e-02, PNorm = 209.6392, GNorm = 0.5166, lr_0 = 9.9990e-04
Loss = 1.0312e-01, PNorm = 209.8973, GNorm = 1.7935, lr_0 = 9.9990e-04
Validation auc = 0.721863
Epoch 740
Loss = 9.1043e-02, PNorm = 210.1908, GNorm = 2.4946, lr_0 = 9.9990e-04
Validation auc = 0.747233
Epoch 741
Loss = 7.6228e-02, PNorm = 210.4629, GNorm = 0.3031, lr_0 = 9.9990e-04
Validation auc = 0.766692
Epoch 742
Loss = 1.3759e-01, PNorm = 210.7367, GNorm = 1.7865, lr_0 = 9.9990e-04
Validation auc = 0.763779
Epoch 743
Loss = 5.1624e-02, PNorm = 210.9987, GNorm = 1.7363, lr_0 = 9.9990e-04
Validation auc = 0.752094
Epoch 744
Loss = 8.8181e-02, PNorm = 211.2289, GNorm = 1.7971, lr_0 = 9.9990e-04
Validation auc = 0.759669
Epoch 745
Loss = 4.7784e-02, PNorm = 211.4865, GNorm = 0.2657, lr_0 = 9.9990e-04
Validation auc = 0.734984
Epoch 746
Loss = 4.7919e-02, PNorm = 211.7342, GNorm = 0.6558, lr_0 = 9.9990e-04
Validation auc = 0.741223
Epoch 747
Loss = 4.0614e-02, PNorm = 211.9841, GNorm = 1.8486, lr_0 = 9.9989e-04
Validation auc = 0.752926
Epoch 748
Loss = 5.2128e-03, PNorm = 212.2197, GNorm = 0.2236, lr_0 = 9.9989e-04
Validation auc = 0.737277
Epoch 749
Loss = 8.7712e-02, PNorm = 212.3880, GNorm = 2.0024, lr_0 = 9.9989e-04
Loss = 3.0483e-02, PNorm = 212.5545, GNorm = 0.4386, lr_0 = 9.9989e-04
Validation auc = 0.734799
Epoch 750
Loss = 1.1011e-01, PNorm = 212.7958, GNorm = 1.9834, lr_0 = 9.9989e-04
Validation auc = 0.738712
Epoch 751
Loss = 3.1445e-02, PNorm = 213.0578, GNorm = 1.1239, lr_0 = 9.9989e-04
Validation auc = 0.738770
Epoch 752
Loss = 4.3565e-02, PNorm = 213.2676, GNorm = 0.1411, lr_0 = 9.9989e-04
Validation auc = 0.723483
Epoch 753
Loss = 9.1181e-02, PNorm = 213.4731, GNorm = 1.0208, lr_0 = 9.9989e-04
Validation auc = 0.745366
Epoch 754
Loss = 5.2570e-02, PNorm = 213.7899, GNorm = 0.3860, lr_0 = 9.9989e-04
Validation auc = 0.754260
Epoch 755
Loss = 4.0941e-02, PNorm = 214.1052, GNorm = 0.5151, lr_0 = 9.9989e-04
Validation auc = 0.752483
Epoch 756
Loss = 5.1412e-02, PNorm = 214.3899, GNorm = 1.6138, lr_0 = 9.9989e-04
Validation auc = 0.746451
Epoch 757
Loss = 5.1616e-02, PNorm = 214.6235, GNorm = 1.5047, lr_0 = 9.9989e-04
Validation auc = 0.742879
Epoch 758
Loss = 4.2905e-02, PNorm = 214.8570, GNorm = 0.9736, lr_0 = 9.9989e-04
Validation auc = 0.735927
Epoch 759
Loss = 4.1257e-02, PNorm = 215.0943, GNorm = 1.1640, lr_0 = 9.9989e-04
Loss = 9.5108e-02, PNorm = 215.3042, GNorm = 3.5324, lr_0 = 9.9988e-04
Validation auc = 0.738031
Epoch 760
Loss = 8.5543e-02, PNorm = 215.5419, GNorm = 0.6188, lr_0 = 9.9988e-04
Validation auc = 0.682621
Epoch 761
Loss = 9.2638e-02, PNorm = 215.8119, GNorm = 0.5396, lr_0 = 9.9988e-04
Validation auc = 0.713124
Epoch 762
Loss = 3.4124e-02, PNorm = 216.0798, GNorm = 0.6303, lr_0 = 9.9988e-04
Validation auc = 0.725790
Epoch 763
Loss = 5.3515e-02, PNorm = 216.2638, GNorm = 1.8737, lr_0 = 9.9988e-04
Validation auc = 0.723569
Epoch 764
Loss = 7.8417e-02, PNorm = 216.4426, GNorm = 0.8599, lr_0 = 9.9988e-04
Validation auc = 0.729725
Epoch 765
Loss = 1.2576e-01, PNorm = 216.6959, GNorm = 0.6623, lr_0 = 9.9988e-04
Validation auc = 0.740582
Epoch 766
Loss = 1.0064e-01, PNorm = 216.9569, GNorm = 2.3266, lr_0 = 9.9988e-04
Validation auc = 0.723058
Epoch 767
Loss = 1.5601e-02, PNorm = 217.2207, GNorm = 0.4878, lr_0 = 9.9988e-04
Validation auc = 0.694220
Epoch 768
Loss = 7.2332e-03, PNorm = 217.4349, GNorm = 0.3749, lr_0 = 9.9988e-04
Validation auc = 0.715360
Epoch 769
Loss = 4.3887e-02, PNorm = 217.6937, GNorm = 1.8990, lr_0 = 9.9988e-04
Loss = 3.3990e-02, PNorm = 217.9217, GNorm = 0.4189, lr_0 = 9.9988e-04
Validation auc = 0.724697
Epoch 770
Loss = 4.0012e-02, PNorm = 218.1019, GNorm = 0.9746, lr_0 = 9.9988e-04
Validation auc = 0.717758
Epoch 771
Loss = 5.6080e-02, PNorm = 218.2686, GNorm = 1.4923, lr_0 = 9.9988e-04
Validation auc = 0.742043
Epoch 772
Loss = 5.7874e-02, PNorm = 218.4847, GNorm = 0.9002, lr_0 = 9.9988e-04
Validation auc = 0.715284
Epoch 773
Loss = 5.8301e-02, PNorm = 218.7129, GNorm = 1.1689, lr_0 = 9.9987e-04
Validation auc = 0.735536
Epoch 774
Loss = 8.8161e-02, PNorm = 218.9525, GNorm = 1.6357, lr_0 = 9.9987e-04
Validation auc = 0.731579
Epoch 775
Loss = 3.9258e-02, PNorm = 219.2326, GNorm = 1.8326, lr_0 = 9.9987e-04
Validation auc = 0.710520
Epoch 776
Loss = 6.9964e-02, PNorm = 219.4899, GNorm = 1.3365, lr_0 = 9.9987e-04
Validation auc = 0.713863
Epoch 777
Loss = 2.6358e-02, PNorm = 219.7601, GNorm = 1.2531, lr_0 = 9.9987e-04
Validation auc = 0.737086
Epoch 778
Loss = 3.2455e-02, PNorm = 219.9929, GNorm = 0.4024, lr_0 = 9.9987e-04
Validation auc = 0.730719
Epoch 779
Loss = 2.4510e-02, PNorm = 220.2059, GNorm = 0.6044, lr_0 = 9.9987e-04
Loss = 3.2312e-02, PNorm = 220.3647, GNorm = 0.1418, lr_0 = 9.9987e-04
Validation auc = 0.714063
Epoch 780
Loss = 3.3385e-02, PNorm = 220.5003, GNorm = 0.5149, lr_0 = 9.9987e-04
Validation auc = 0.702190
Epoch 781
Loss = 2.2200e-02, PNorm = 220.6288, GNorm = 1.7410, lr_0 = 9.9987e-04
Validation auc = 0.711402
Epoch 782
Loss = 5.9187e-02, PNorm = 220.7697, GNorm = 2.0185, lr_0 = 9.9987e-04
Validation auc = 0.726395
Epoch 783
Loss = 4.9697e-02, PNorm = 220.9829, GNorm = 1.4433, lr_0 = 9.9987e-04
Validation auc = 0.746310
Epoch 784
Loss = 1.2075e-01, PNorm = 221.2419, GNorm = 1.3547, lr_0 = 9.9987e-04
Validation auc = 0.747612
Epoch 785
Loss = 8.5384e-02, PNorm = 221.5336, GNorm = 0.8920, lr_0 = 9.9987e-04
Validation auc = 0.744200
Epoch 786
Loss = 1.3244e-01, PNorm = 221.8846, GNorm = 1.7707, lr_0 = 9.9986e-04
Validation auc = 0.746509
Epoch 787
Loss = 7.2506e-02, PNorm = 222.2414, GNorm = 1.9394, lr_0 = 9.9986e-04
Validation auc = 0.766306
Epoch 788
Loss = 5.0368e-02, PNorm = 222.5745, GNorm = 0.7943, lr_0 = 9.9986e-04
Validation auc = 0.757321
Epoch 789
Loss = 1.9636e-01, PNorm = 222.8603, GNorm = 2.4314, lr_0 = 9.9986e-04
Loss = 5.6391e-02, PNorm = 223.1236, GNorm = 0.8971, lr_0 = 9.9986e-04
Validation auc = 0.735660
Epoch 790
Loss = 4.9893e-02, PNorm = 223.3465, GNorm = 2.3410, lr_0 = 9.9986e-04
Validation auc = 0.727198
Epoch 791
Loss = 4.2673e-02, PNorm = 223.5483, GNorm = 0.6583, lr_0 = 9.9986e-04
Validation auc = 0.748498
Epoch 792
Loss = 6.1689e-02, PNorm = 223.7892, GNorm = 3.2575, lr_0 = 9.9986e-04
Validation auc = 0.745931
Epoch 793
Loss = 7.0232e-02, PNorm = 224.0543, GNorm = 0.3280, lr_0 = 9.9986e-04
Validation auc = 0.730366
Epoch 794
Loss = 6.0032e-02, PNorm = 224.2749, GNorm = 1.1476, lr_0 = 9.9986e-04
Validation auc = 0.731234
Epoch 795
Loss = 6.3666e-02, PNorm = 224.4920, GNorm = 0.3092, lr_0 = 9.9986e-04
Validation auc = 0.740261
Epoch 796
Loss = 6.2072e-02, PNorm = 224.6821, GNorm = 0.0910, lr_0 = 9.9986e-04
Validation auc = 0.745058
Epoch 797
Loss = 3.0342e-02, PNorm = 224.8567, GNorm = 0.5280, lr_0 = 9.9986e-04
Validation auc = 0.735764
Epoch 798
Loss = 6.2576e-02, PNorm = 225.0167, GNorm = 2.4704, lr_0 = 9.9986e-04
Validation auc = 0.720523
Epoch 799
Loss = 1.4362e-01, PNorm = 225.2081, GNorm = 2.3350, lr_0 = 9.9986e-04
Loss = 9.9774e-02, PNorm = 225.4076, GNorm = 0.9794, lr_0 = 9.9985e-04
Validation auc = 0.712177
Epoch 800
Loss = 3.8585e-02, PNorm = 225.6166, GNorm = 0.1433, lr_0 = 9.9985e-04
Validation auc = 0.720156
Epoch 801
Loss = 6.1673e-02, PNorm = 225.8287, GNorm = 2.4349, lr_0 = 9.9985e-04
Validation auc = 0.734450
Epoch 802
Loss = 3.3347e-02, PNorm = 226.0511, GNorm = 0.7405, lr_0 = 9.9985e-04
Validation auc = 0.713727
Epoch 803
Loss = 2.8282e-02, PNorm = 226.2558, GNorm = 0.0561, lr_0 = 9.9985e-04
Validation auc = 0.715423
Epoch 804
Loss = 3.2661e-02, PNorm = 226.4597, GNorm = 1.7837, lr_0 = 9.9985e-04
Validation auc = 0.725605
Epoch 805
Loss = 8.7813e-02, PNorm = 226.6750, GNorm = 0.0526, lr_0 = 9.9985e-04
Validation auc = 0.731672
Epoch 806
Loss = 5.8716e-02, PNorm = 226.9194, GNorm = 0.9364, lr_0 = 9.9985e-04
Validation auc = 0.704793
Epoch 807
Loss = 6.4517e-02, PNorm = 227.2078, GNorm = 2.0944, lr_0 = 9.9985e-04
Validation auc = 0.721034
Epoch 808
Loss = 1.5131e-02, PNorm = 227.4500, GNorm = 1.0201, lr_0 = 9.9985e-04
Validation auc = 0.730977
Epoch 809
Loss = 2.1387e-02, PNorm = 227.6375, GNorm = 0.4978, lr_0 = 9.9985e-04
Loss = 5.2817e-02, PNorm = 227.7798, GNorm = 0.3823, lr_0 = 9.9985e-04
Validation auc = 0.739229
Epoch 810
Loss = 5.1670e-02, PNorm = 227.9518, GNorm = 0.4731, lr_0 = 9.9985e-04
Validation auc = 0.737154
Epoch 811
Loss = 4.3519e-02, PNorm = 228.1164, GNorm = 2.9277, lr_0 = 9.9985e-04
Validation auc = 0.719716
Epoch 812
Loss = 8.1910e-02, PNorm = 228.3063, GNorm = 1.7463, lr_0 = 9.9985e-04
Validation auc = 0.738719
Epoch 813
Loss = 4.0604e-02, PNorm = 228.5816, GNorm = 1.4684, lr_0 = 9.9984e-04
Validation auc = 0.734563
Epoch 814
Loss = 8.9546e-02, PNorm = 228.8429, GNorm = 1.6984, lr_0 = 9.9984e-04
Validation auc = 0.715357
Epoch 815
Loss = 2.3527e-02, PNorm = 229.1268, GNorm = 0.2890, lr_0 = 9.9984e-04
Validation auc = 0.745002
Epoch 816
Loss = 3.0904e-02, PNorm = 229.3683, GNorm = 1.5697, lr_0 = 9.9984e-04
Validation auc = 0.727380
Epoch 817
Loss = 6.8089e-02, PNorm = 229.5741, GNorm = 1.4790, lr_0 = 9.9984e-04
Validation auc = 0.738530
Epoch 818
Loss = 2.4886e-02, PNorm = 229.7587, GNorm = 0.3079, lr_0 = 9.9984e-04
Validation auc = 0.749942
Epoch 819
Loss = 5.5553e-02, PNorm = 229.9450, GNorm = 0.9954, lr_0 = 9.9984e-04
Loss = 7.0888e-02, PNorm = 230.1288, GNorm = 0.8762, lr_0 = 9.9984e-04
Validation auc = 0.738842
Epoch 820
Loss = 4.0081e-02, PNorm = 230.2854, GNorm = 0.5834, lr_0 = 9.9984e-04
Validation auc = 0.723991
Epoch 821
Loss = 4.6809e-02, PNorm = 230.4529, GNorm = 2.6461, lr_0 = 9.9984e-04
Validation auc = 0.708881
Epoch 822
Loss = 6.5099e-02, PNorm = 230.6158, GNorm = 0.2908, lr_0 = 9.9984e-04
Validation auc = 0.734399
Epoch 823
Loss = 6.3173e-02, PNorm = 230.7708, GNorm = 2.0189, lr_0 = 9.9984e-04
Validation auc = 0.721749
Epoch 824
Loss = 3.8054e-02, PNorm = 230.9670, GNorm = 0.7627, lr_0 = 9.9984e-04
Validation auc = 0.705837
Epoch 825
Loss = 2.0703e-02, PNorm = 231.1465, GNorm = 0.2549, lr_0 = 9.9984e-04
Validation auc = 0.719536
Epoch 826
Loss = 3.1459e-02, PNorm = 231.2709, GNorm = 1.4886, lr_0 = 9.9983e-04
Validation auc = 0.723579
Epoch 827
Loss = 1.1989e-01, PNorm = 231.3866, GNorm = 1.2320, lr_0 = 9.9983e-04
Validation auc = 0.736079
Epoch 828
Loss = 3.5540e-02, PNorm = 231.5591, GNorm = 1.3576, lr_0 = 9.9983e-04
Validation auc = 0.734568
Epoch 829
Loss = 5.8751e-02, PNorm = 231.7508, GNorm = 1.5100, lr_0 = 9.9983e-04
Loss = 6.8555e-02, PNorm = 231.9547, GNorm = 1.9569, lr_0 = 9.9983e-04
Validation auc = 0.741916
Epoch 830
Loss = 4.1808e-02, PNorm = 232.1693, GNorm = 1.3345, lr_0 = 9.9983e-04
Validation auc = 0.761516
Epoch 831
Loss = 2.3283e-02, PNorm = 232.3243, GNorm = 0.4860, lr_0 = 9.9983e-04
Validation auc = 0.762540
Epoch 832
Loss = 2.9450e-02, PNorm = 232.4356, GNorm = 0.3867, lr_0 = 9.9983e-04
Validation auc = 0.770088
Epoch 833
Loss = 7.3547e-02, PNorm = 232.5451, GNorm = 0.3411, lr_0 = 9.9983e-04
Validation auc = 0.751114
Epoch 834
Loss = 2.5978e-02, PNorm = 232.6853, GNorm = 1.1483, lr_0 = 9.9983e-04
Validation auc = 0.735369
Epoch 835
Loss = 3.1863e-02, PNorm = 232.8174, GNorm = 1.3911, lr_0 = 9.9983e-04
Validation auc = 0.753924
Epoch 836
Loss = 4.2447e-02, PNorm = 232.9684, GNorm = 1.4337, lr_0 = 9.9983e-04
Validation auc = 0.755219
Epoch 837
Loss = 2.7944e-02, PNorm = 233.1545, GNorm = 0.2652, lr_0 = 9.9983e-04
Validation auc = 0.748390
Epoch 838
Loss = 6.5783e-02, PNorm = 233.3178, GNorm = 2.2115, lr_0 = 9.9983e-04
Validation auc = 0.739597
Epoch 839
Loss = 1.6146e-02, PNorm = 233.4785, GNorm = 1.2303, lr_0 = 9.9983e-04
Loss = 5.2500e-02, PNorm = 233.6427, GNorm = 0.7846, lr_0 = 9.9982e-04
Validation auc = 0.719391
Epoch 840
Loss = 7.8115e-02, PNorm = 233.8498, GNorm = 2.7868, lr_0 = 9.9982e-04
Validation auc = 0.715589
Epoch 841
Loss = 3.4870e-02, PNorm = 234.0997, GNorm = 0.6551, lr_0 = 9.9982e-04
Validation auc = 0.738190
Epoch 842
Loss = 4.1465e-02, PNorm = 234.3375, GNorm = 1.6998, lr_0 = 9.9982e-04
Validation auc = 0.729872
Epoch 843
Loss = 6.3616e-02, PNorm = 234.5532, GNorm = 1.9048, lr_0 = 9.9982e-04
Validation auc = 0.721317
Epoch 844
Loss = 4.2689e-02, PNorm = 234.7558, GNorm = 0.6779, lr_0 = 9.9982e-04
Validation auc = 0.740862
Epoch 845
Loss = 5.7558e-03, PNorm = 234.9185, GNorm = 0.5517, lr_0 = 9.9982e-04
Validation auc = 0.749619
Epoch 846
Loss = 1.1947e-02, PNorm = 235.0281, GNorm = 0.3858, lr_0 = 9.9982e-04
Validation auc = 0.734436
Epoch 847
Loss = 4.7132e-02, PNorm = 235.1264, GNorm = 1.5151, lr_0 = 9.9982e-04
Validation auc = 0.740050
Epoch 848
Loss = 1.4395e-02, PNorm = 235.2562, GNorm = 0.3090, lr_0 = 9.9982e-04
Validation auc = 0.753033
Epoch 849
Loss = 5.6876e-02, PNorm = 235.4223, GNorm = 1.7496, lr_0 = 9.9982e-04
Loss = 4.2793e-02, PNorm = 235.6831, GNorm = 0.3696, lr_0 = 9.9982e-04
Validation auc = 0.731674
Epoch 850
Loss = 3.1431e-02, PNorm = 235.9172, GNorm = 0.1042, lr_0 = 9.9982e-04
Validation auc = 0.721681
Epoch 851
Loss = 4.8263e-02, PNorm = 236.1329, GNorm = 3.3839, lr_0 = 9.9982e-04
Validation auc = 0.700519
Epoch 852
Loss = 2.7260e-02, PNorm = 236.3295, GNorm = 0.2423, lr_0 = 9.9981e-04
Validation auc = 0.721354
Epoch 853
Loss = 4.1970e-02, PNorm = 236.5298, GNorm = 0.1658, lr_0 = 9.9981e-04
Validation auc = 0.733830
Epoch 854
Loss = 1.0507e-01, PNorm = 236.7381, GNorm = 0.5111, lr_0 = 9.9981e-04
Validation auc = 0.739826
Epoch 855
Loss = 4.3886e-02, PNorm = 236.9695, GNorm = 0.1813, lr_0 = 9.9981e-04
Validation auc = 0.728216
Epoch 856
Loss = 2.4841e-02, PNorm = 237.1708, GNorm = 1.1719, lr_0 = 9.9981e-04
Validation auc = 0.709950
Epoch 857
Loss = 8.6787e-03, PNorm = 237.3342, GNorm = 0.5389, lr_0 = 9.9981e-04
Validation auc = 0.733195
Epoch 858
Loss = 1.9021e-01, PNorm = 237.5320, GNorm = 2.0391, lr_0 = 9.9981e-04
Validation auc = 0.746185
Epoch 859
Loss = 2.2241e-03, PNorm = 237.7724, GNorm = 0.0747, lr_0 = 9.9981e-04
Loss = 5.4447e-02, PNorm = 238.0207, GNorm = 0.8880, lr_0 = 9.9981e-04
Validation auc = 0.745461
Epoch 860
Loss = 5.9980e-02, PNorm = 238.2309, GNorm = 2.3891, lr_0 = 9.9981e-04
Validation auc = 0.733162
Epoch 861
Loss = 3.9041e-02, PNorm = 238.4426, GNorm = 0.6017, lr_0 = 9.9981e-04
Validation auc = 0.732168
Epoch 862
Loss = 2.3515e-02, PNorm = 238.6374, GNorm = 0.0843, lr_0 = 9.9981e-04
Validation auc = 0.721776
Epoch 863
Loss = 7.0424e-02, PNorm = 238.8438, GNorm = 5.4650, lr_0 = 9.9981e-04
Validation auc = 0.724438
Epoch 864
Loss = 2.0747e-02, PNorm = 239.1475, GNorm = 0.6519, lr_0 = 9.9981e-04
Validation auc = 0.732542
Epoch 865
Loss = 2.3340e-02, PNorm = 239.4066, GNorm = 1.0127, lr_0 = 9.9981e-04
Validation auc = 0.724361
Epoch 866
Loss = 2.5013e-02, PNorm = 239.6465, GNorm = 0.2557, lr_0 = 9.9980e-04
Validation auc = 0.721896
Epoch 867
Loss = 3.7849e-02, PNorm = 239.8852, GNorm = 0.4531, lr_0 = 9.9980e-04
Validation auc = 0.727888
Epoch 868
Loss = 6.4653e-02, PNorm = 240.0780, GNorm = 1.1196, lr_0 = 9.9980e-04
Validation auc = 0.729484
Epoch 869
Loss = 1.0455e-02, PNorm = 240.2517, GNorm = 0.2973, lr_0 = 9.9980e-04
Loss = 2.2799e-02, PNorm = 240.4044, GNorm = 2.4936, lr_0 = 9.9980e-04
Validation auc = 0.725928
Epoch 870
Loss = 4.4439e-02, PNorm = 240.5644, GNorm = 3.1854, lr_0 = 9.9980e-04
Validation auc = 0.712034
Epoch 871
Loss = 4.3333e-02, PNorm = 240.7161, GNorm = 1.7270, lr_0 = 9.9980e-04
Validation auc = 0.700698
Epoch 872
Loss = 3.5306e-02, PNorm = 240.9014, GNorm = 2.5101, lr_0 = 9.9980e-04
Validation auc = 0.718313
Epoch 873
Loss = 2.3716e-02, PNorm = 241.1206, GNorm = 1.1806, lr_0 = 9.9980e-04
Validation auc = 0.717811
Epoch 874
Loss = 1.5362e-01, PNorm = 241.3367, GNorm = 1.9800, lr_0 = 9.9980e-04
Validation auc = 0.729912
Epoch 875
Loss = 3.3493e-02, PNorm = 241.6226, GNorm = 0.9342, lr_0 = 9.9980e-04
Validation auc = 0.743889
Epoch 876
Loss = 3.1854e-02, PNorm = 241.8520, GNorm = 1.5414, lr_0 = 9.9980e-04
Validation auc = 0.747789
Epoch 877
Loss = 4.8080e-02, PNorm = 242.0364, GNorm = 0.9009, lr_0 = 9.9980e-04
Validation auc = 0.682040
Epoch 878
Loss = 4.9815e-02, PNorm = 242.2374, GNorm = 1.3538, lr_0 = 9.9980e-04
Validation auc = 0.651285
Epoch 879
Loss = 9.1151e-03, PNorm = 242.4574, GNorm = 0.2941, lr_0 = 9.9979e-04
Loss = 5.3728e-02, PNorm = 242.6835, GNorm = 1.6287, lr_0 = 9.9979e-04
Validation auc = 0.693520
Epoch 880
Loss = 1.0680e-01, PNorm = 242.9044, GNorm = 0.3940, lr_0 = 9.9979e-04
Validation auc = 0.733318
Epoch 881
Loss = 6.1654e-02, PNorm = 243.1377, GNorm = 0.4401, lr_0 = 9.9979e-04
Validation auc = 0.726361
Epoch 882
Loss = 2.6620e-02, PNorm = 243.3185, GNorm = 1.3671, lr_0 = 9.9979e-04
Validation auc = 0.739815
Epoch 883
Loss = 9.3052e-03, PNorm = 243.4743, GNorm = 0.1599, lr_0 = 9.9979e-04
Validation auc = 0.740294
Epoch 884
Loss = 7.0878e-03, PNorm = 243.5987, GNorm = 2.0721, lr_0 = 9.9979e-04
Validation auc = 0.731890
Epoch 885
Loss = 6.2131e-02, PNorm = 243.8343, GNorm = 0.2488, lr_0 = 9.9979e-04
Validation auc = 0.734960
Epoch 886
Loss = 1.0349e-01, PNorm = 244.1735, GNorm = 1.2605, lr_0 = 9.9979e-04
Validation auc = 0.751673
Epoch 887
Loss = 5.5625e-02, PNorm = 244.5158, GNorm = 1.8322, lr_0 = 9.9979e-04
Validation auc = 0.753802
Epoch 888
Loss = 5.6936e-02, PNorm = 244.8123, GNorm = 0.6425, lr_0 = 9.9979e-04
Validation auc = 0.729194
Epoch 889
Loss = 2.0281e-02, PNorm = 245.1139, GNorm = 1.3116, lr_0 = 9.9979e-04
Loss = 7.5347e-02, PNorm = 245.3906, GNorm = 0.9218, lr_0 = 9.9979e-04
Validation auc = 0.745241
Epoch 890
Loss = 3.1107e-02, PNorm = 245.6248, GNorm = 2.1940, lr_0 = 9.9979e-04
Validation auc = 0.748428
Epoch 891
Loss = 4.7787e-02, PNorm = 245.7993, GNorm = 1.4156, lr_0 = 9.9979e-04
Validation auc = 0.744957
Epoch 892
Loss = 2.7324e-02, PNorm = 245.9480, GNorm = 1.4335, lr_0 = 9.9978e-04
Validation auc = 0.739250
Epoch 893
Loss = 1.0478e-01, PNorm = 246.0749, GNorm = 1.9514, lr_0 = 9.9978e-04
Validation auc = 0.730361
Epoch 894
Loss = 7.3769e-02, PNorm = 246.2132, GNorm = 1.8517, lr_0 = 9.9978e-04
Validation auc = 0.706402
Epoch 895
Loss = 5.1566e-02, PNorm = 246.4075, GNorm = 5.1450, lr_0 = 9.9978e-04
Validation auc = 0.707040
Epoch 896
Loss = 1.5104e-02, PNorm = 246.6313, GNorm = 0.2757, lr_0 = 9.9978e-04
Validation auc = 0.715559
Epoch 897
Loss = 4.3271e-02, PNorm = 246.8318, GNorm = 0.7548, lr_0 = 9.9978e-04
Validation auc = 0.723786
Epoch 898
Loss = 4.6857e-02, PNorm = 247.0384, GNorm = 0.5951, lr_0 = 9.9978e-04
Validation auc = 0.721346
Epoch 899
Loss = 3.6689e-03, PNorm = 247.2266, GNorm = 0.0919, lr_0 = 9.9978e-04
Loss = 5.5159e-02, PNorm = 247.3806, GNorm = 2.0854, lr_0 = 9.9978e-04
Validation auc = 0.711637
Epoch 900
Loss = 3.2175e-02, PNorm = 247.5690, GNorm = 0.6485, lr_0 = 9.9978e-04
Validation auc = 0.701387
Epoch 901
Loss = 4.7032e-02, PNorm = 247.7528, GNorm = 2.1048, lr_0 = 9.9978e-04
Validation auc = 0.696797
Epoch 902
Loss = 3.7793e-02, PNorm = 247.9908, GNorm = 3.4474, lr_0 = 9.9978e-04
Validation auc = 0.717017
Epoch 903
Loss = 5.9222e-02, PNorm = 248.2144, GNorm = 0.5539, lr_0 = 9.9978e-04
Validation auc = 0.726069
Epoch 904
Loss = 5.5114e-02, PNorm = 248.4141, GNorm = 0.1311, lr_0 = 9.9978e-04
Validation auc = 0.732570
Epoch 905
Loss = 9.6913e-02, PNorm = 248.6234, GNorm = 3.5465, lr_0 = 9.9977e-04
Validation auc = 0.727157
Epoch 906
Loss = 5.5426e-02, PNorm = 248.8452, GNorm = 1.1665, lr_0 = 9.9977e-04
Validation auc = 0.714950
Epoch 907
Loss = 7.7647e-02, PNorm = 249.0837, GNorm = 1.5666, lr_0 = 9.9977e-04
Validation auc = 0.702332
Epoch 908
Loss = 1.3637e-02, PNorm = 249.2881, GNorm = 0.2619, lr_0 = 9.9977e-04
Validation auc = 0.728391
Epoch 909
Loss = 1.5439e-01, PNorm = 249.4605, GNorm = 5.2789, lr_0 = 9.9977e-04
Loss = 2.5777e-02, PNorm = 249.6704, GNorm = 2.7279, lr_0 = 9.9977e-04
Validation auc = 0.714906
Epoch 910
Loss = 1.1696e-01, PNorm = 249.9977, GNorm = 0.0712, lr_0 = 9.9977e-04
Validation auc = 0.681318
Epoch 911
Loss = 8.5717e-02, PNorm = 250.3157, GNorm = 1.2317, lr_0 = 9.9977e-04
Validation auc = 0.674185
Epoch 912
Loss = 5.1505e-02, PNorm = 250.6361, GNorm = 0.0657, lr_0 = 9.9977e-04
Validation auc = 0.681772
Epoch 913
Loss = 6.2572e-02, PNorm = 250.8896, GNorm = 0.6845, lr_0 = 9.9977e-04
Validation auc = 0.686378
Epoch 914
Loss = 5.6471e-02, PNorm = 251.0919, GNorm = 0.2447, lr_0 = 9.9977e-04
Validation auc = 0.691791
Epoch 915
Loss = 6.7015e-02, PNorm = 251.2792, GNorm = 0.9065, lr_0 = 9.9977e-04
Validation auc = 0.700130
Epoch 916
Loss = 6.9198e-02, PNorm = 251.5161, GNorm = 0.7771, lr_0 = 9.9977e-04
Validation auc = 0.724185
Epoch 917
Loss = 4.5652e-02, PNorm = 251.7516, GNorm = 2.2844, lr_0 = 9.9977e-04
Validation auc = 0.737275
Epoch 918
Loss = 6.9510e-03, PNorm = 251.9289, GNorm = 0.0770, lr_0 = 9.9977e-04
Validation auc = 0.734222
Epoch 919
Loss = 5.4812e-03, PNorm = 252.0389, GNorm = 0.2329, lr_0 = 9.9976e-04
Loss = 4.7359e-02, PNorm = 252.1494, GNorm = 0.0829, lr_0 = 9.9976e-04
Validation auc = 0.733602
Epoch 920
Loss = 4.7556e-02, PNorm = 252.2947, GNorm = 2.7054, lr_0 = 9.9976e-04
Validation auc = 0.741147
Epoch 921
Loss = 3.9139e-02, PNorm = 252.4333, GNorm = 4.9369, lr_0 = 9.9976e-04
Validation auc = 0.748596
Epoch 922
Loss = 7.8589e-02, PNorm = 252.6257, GNorm = 0.3536, lr_0 = 9.9976e-04
Validation auc = 0.740954
Epoch 923
Loss = 3.5204e-02, PNorm = 252.8054, GNorm = 0.5187, lr_0 = 9.9976e-04
Validation auc = 0.728548
Epoch 924
Loss = 2.9891e-02, PNorm = 252.9493, GNorm = 1.7978, lr_0 = 9.9976e-04
Validation auc = 0.742338
Epoch 925
Loss = 2.3394e-02, PNorm = 253.0711, GNorm = 0.1781, lr_0 = 9.9976e-04
Validation auc = 0.751638
Epoch 926
Loss = 1.0167e-01, PNorm = 253.1991, GNorm = 2.6016, lr_0 = 9.9976e-04
Validation auc = 0.742666
Epoch 927
Loss = 4.5911e-02, PNorm = 253.3847, GNorm = 0.2101, lr_0 = 9.9976e-04
Validation auc = 0.753963
Epoch 928
Loss = 2.3930e-02, PNorm = 253.6260, GNorm = 1.3300, lr_0 = 9.9976e-04
Validation auc = 0.742076
Epoch 929
Loss = 2.2795e-03, PNorm = 253.8851, GNorm = 0.0860, lr_0 = 9.9976e-04
Loss = 6.0505e-02, PNorm = 254.1542, GNorm = 1.5169, lr_0 = 9.9976e-04
Validation auc = 0.720797
Epoch 930
Loss = 4.0124e-02, PNorm = 254.3658, GNorm = 0.8836, lr_0 = 9.9976e-04
Validation auc = 0.721061
Epoch 931
Loss = 6.5550e-02, PNorm = 254.5400, GNorm = 0.4991, lr_0 = 9.9975e-04
Validation auc = 0.734574
Epoch 932
Loss = 2.2867e-02, PNorm = 254.7156, GNorm = 2.9545, lr_0 = 9.9975e-04
Validation auc = 0.730273
Epoch 933
Loss = 4.4554e-02, PNorm = 254.8653, GNorm = 0.7070, lr_0 = 9.9975e-04
Validation auc = 0.722310
Epoch 934
Loss = 3.9807e-02, PNorm = 255.0028, GNorm = 0.4704, lr_0 = 9.9975e-04
Validation auc = 0.732407
Epoch 935
Loss = 4.2705e-02, PNorm = 255.1727, GNorm = 0.1512, lr_0 = 9.9975e-04
Validation auc = 0.719329
Epoch 936
Loss = 4.3833e-02, PNorm = 255.4102, GNorm = 0.3647, lr_0 = 9.9975e-04
Validation auc = 0.736501
Epoch 937
Loss = 4.2142e-02, PNorm = 255.6374, GNorm = 1.6670, lr_0 = 9.9975e-04
Validation auc = 0.719566
Epoch 938
Loss = 3.3108e-02, PNorm = 255.8857, GNorm = 0.9651, lr_0 = 9.9975e-04
Validation auc = 0.734620
Epoch 939
Loss = 2.3595e-02, PNorm = 256.1268, GNorm = 0.7576, lr_0 = 9.9975e-04
Loss = 2.3725e-02, PNorm = 256.3319, GNorm = 0.9393, lr_0 = 9.9975e-04
Validation auc = 0.748079
Epoch 940
Loss = 4.1861e-02, PNorm = 256.4936, GNorm = 1.0674, lr_0 = 9.9975e-04
Validation auc = 0.742288
Epoch 941
Loss = 2.3064e-02, PNorm = 256.6114, GNorm = 0.3305, lr_0 = 9.9975e-04
Validation auc = 0.739433
Epoch 942
Loss = 2.4744e-02, PNorm = 256.7156, GNorm = 0.7507, lr_0 = 9.9975e-04
Validation auc = 0.743392
Epoch 943
Loss = 1.0014e-01, PNorm = 256.8854, GNorm = 0.0919, lr_0 = 9.9975e-04
Validation auc = 0.709133
Epoch 944
Loss = 1.3060e-01, PNorm = 257.1808, GNorm = 0.7628, lr_0 = 9.9975e-04
Validation auc = 0.679584
Epoch 945
Loss = 4.0987e-02, PNorm = 257.4629, GNorm = 1.7835, lr_0 = 9.9974e-04
Validation auc = 0.680924
Epoch 946
Loss = 1.5443e-02, PNorm = 257.6916, GNorm = 0.5354, lr_0 = 9.9974e-04
Validation auc = 0.696430
Epoch 947
Loss = 4.6058e-02, PNorm = 257.8560, GNorm = 0.6371, lr_0 = 9.9974e-04
Validation auc = 0.715916
Epoch 948
Loss = 9.2279e-03, PNorm = 257.9725, GNorm = 0.0375, lr_0 = 9.9974e-04
Validation auc = 0.698333
Epoch 949
Loss = 2.1385e-02, PNorm = 258.1018, GNorm = 0.8853, lr_0 = 9.9974e-04
Loss = 3.9311e-02, PNorm = 258.2652, GNorm = 1.2351, lr_0 = 9.9974e-04
Validation auc = 0.697842
Epoch 950
Loss = 8.4606e-02, PNorm = 258.4854, GNorm = 1.1751, lr_0 = 9.9974e-04
Validation auc = 0.715210
Epoch 951
Loss = 5.4229e-02, PNorm = 258.7369, GNorm = 0.0404, lr_0 = 9.9974e-04
Validation auc = 0.702945
Epoch 952
Loss = 7.1183e-02, PNorm = 258.9258, GNorm = 0.7381, lr_0 = 9.9974e-04
Validation auc = 0.703499
Epoch 953
Loss = 4.3148e-02, PNorm = 259.1082, GNorm = 1.2987, lr_0 = 9.9974e-04
Validation auc = 0.719504
Epoch 954
Loss = 3.1005e-02, PNorm = 259.2575, GNorm = 0.1186, lr_0 = 9.9974e-04
Validation auc = 0.711899
Epoch 955
Loss = 8.4493e-02, PNorm = 259.3696, GNorm = 0.1376, lr_0 = 9.9974e-04
Validation auc = 0.709575
Epoch 956
Loss = 3.6075e-02, PNorm = 259.4753, GNorm = 1.8735, lr_0 = 9.9974e-04
Validation auc = 0.728275
Epoch 957
Loss = 1.6044e-02, PNorm = 259.5842, GNorm = 1.4049, lr_0 = 9.9974e-04
Validation auc = 0.709079
Epoch 958
Loss = 1.5461e-02, PNorm = 259.7336, GNorm = 1.1341, lr_0 = 9.9973e-04
Validation auc = 0.714918
Epoch 959
Loss = 2.6263e-02, PNorm = 259.9437, GNorm = 0.8121, lr_0 = 9.9973e-04
Loss = 1.1386e-01, PNorm = 260.1418, GNorm = 3.3795, lr_0 = 9.9973e-04
Validation auc = 0.734105
Epoch 960
Loss = 7.8443e-02, PNorm = 260.3469, GNorm = 3.1928, lr_0 = 9.9973e-04
Validation auc = 0.732557
Epoch 961
Loss = 3.8190e-02, PNorm = 260.5408, GNorm = 0.6451, lr_0 = 9.9973e-04
Validation auc = 0.731743
Epoch 962
Loss = 2.6336e-02, PNorm = 260.7166, GNorm = 0.3069, lr_0 = 9.9973e-04
Validation auc = 0.742483
Epoch 963
Loss = 5.5416e-02, PNorm = 260.8833, GNorm = 4.7490, lr_0 = 9.9973e-04
Validation auc = 0.728921
Epoch 964
Loss = 5.2705e-02, PNorm = 261.0756, GNorm = 1.4020, lr_0 = 9.9973e-04
Validation auc = 0.736450
Epoch 965
Loss = 7.8711e-02, PNorm = 261.2881, GNorm = 0.4698, lr_0 = 9.9973e-04
Validation auc = 0.744914
Epoch 966
Loss = 1.1060e-02, PNorm = 261.5303, GNorm = 0.6305, lr_0 = 9.9973e-04
Validation auc = 0.743285
Epoch 967
Loss = 3.0358e-02, PNorm = 261.7348, GNorm = 0.6360, lr_0 = 9.9973e-04
Validation auc = 0.720712
Epoch 968
Loss = 4.4922e-02, PNorm = 261.9647, GNorm = 1.3983, lr_0 = 9.9973e-04
Validation auc = 0.720478
Epoch 969
Loss = 2.7707e-02, PNorm = 262.1989, GNorm = 0.9227, lr_0 = 9.9973e-04
Loss = 5.6740e-02, PNorm = 262.4147, GNorm = 2.7308, lr_0 = 9.9973e-04
Validation auc = 0.720788
Epoch 970
Loss = 6.3967e-02, PNorm = 262.5977, GNorm = 0.3213, lr_0 = 9.9973e-04
Validation auc = 0.720780
Epoch 971
Loss = 6.5981e-02, PNorm = 262.7802, GNorm = 0.6921, lr_0 = 9.9972e-04
Validation auc = 0.699420
Epoch 972
Loss = 2.5747e-02, PNorm = 262.9535, GNorm = 0.8521, lr_0 = 9.9972e-04
Validation auc = 0.708533
Epoch 973
Loss = 4.6211e-02, PNorm = 263.0853, GNorm = 0.4137, lr_0 = 9.9972e-04
Validation auc = 0.697809
Epoch 974
Loss = 4.1462e-02, PNorm = 263.2058, GNorm = 3.1112, lr_0 = 9.9972e-04
Validation auc = 0.724901
Epoch 975
Loss = 3.9783e-02, PNorm = 263.3436, GNorm = 1.7089, lr_0 = 9.9972e-04
Validation auc = 0.736910
Epoch 976
Loss = 1.5175e-02, PNorm = 263.4899, GNorm = 0.6982, lr_0 = 9.9972e-04
Validation auc = 0.726251
Epoch 977
Loss = 5.9064e-02, PNorm = 263.6500, GNorm = 1.9631, lr_0 = 9.9972e-04
Validation auc = 0.726353
Epoch 978
Loss = 1.5942e-02, PNorm = 263.8711, GNorm = 0.4354, lr_0 = 9.9972e-04
Validation auc = 0.727524
Epoch 979
Loss = 4.8164e-02, PNorm = 264.0939, GNorm = 1.6065, lr_0 = 9.9972e-04
Loss = 5.2147e-02, PNorm = 264.4236, GNorm = 0.6098, lr_0 = 9.9972e-04
Validation auc = 0.709919
Epoch 980
Loss = 9.2789e-02, PNorm = 264.7183, GNorm = 3.4929, lr_0 = 9.9972e-04
Validation auc = 0.711772
Epoch 981
Loss = 1.2926e-01, PNorm = 265.0150, GNorm = 0.3120, lr_0 = 9.9972e-04
Validation auc = 0.719910
Epoch 982
Loss = 3.9378e-02, PNorm = 265.2592, GNorm = 0.2575, lr_0 = 9.9972e-04
Validation auc = 0.715054
Epoch 983
Loss = 3.2994e-02, PNorm = 265.4494, GNorm = 0.7135, lr_0 = 9.9972e-04
Validation auc = 0.714549
Epoch 984
Loss = 7.0005e-02, PNorm = 265.5898, GNorm = 0.1582, lr_0 = 9.9971e-04
Validation auc = 0.728497
Epoch 985
Loss = 7.8817e-02, PNorm = 265.7506, GNorm = 0.0984, lr_0 = 9.9971e-04
Validation auc = 0.720114
Epoch 986
Loss = 3.4488e-02, PNorm = 265.9321, GNorm = 0.1226, lr_0 = 9.9971e-04
Validation auc = 0.704672
Epoch 987
Loss = 1.0214e-02, PNorm = 266.0955, GNorm = 0.1149, lr_0 = 9.9971e-04
Validation auc = 0.709096
Epoch 988
Loss = 1.1107e-01, PNorm = 266.2278, GNorm = 2.5453, lr_0 = 9.9971e-04
Validation auc = 0.720844
Epoch 989
Loss = 3.1722e-03, PNorm = 266.3763, GNorm = 0.2231, lr_0 = 9.9971e-04
Loss = 5.7447e-02, PNorm = 266.4961, GNorm = 3.5320, lr_0 = 9.9971e-04
Validation auc = 0.721843
Epoch 990
Loss = 3.6244e-02, PNorm = 266.6351, GNorm = 0.8482, lr_0 = 9.9971e-04
Validation auc = 0.730638
Epoch 991
Loss = 4.5621e-02, PNorm = 266.7921, GNorm = 0.7479, lr_0 = 9.9971e-04
Validation auc = 0.733869
Epoch 992
Loss = 1.7673e-02, PNorm = 266.9470, GNorm = 1.1987, lr_0 = 9.9971e-04
Validation auc = 0.730115
Epoch 993
Loss = 6.8107e-02, PNorm = 267.1002, GNorm = 0.6253, lr_0 = 9.9971e-04
Validation auc = 0.708502
Epoch 994
Loss = 5.2361e-02, PNorm = 267.2881, GNorm = 1.4161, lr_0 = 9.9971e-04
Validation auc = 0.718959
Epoch 995
Loss = 8.7484e-02, PNorm = 267.4960, GNorm = 0.2670, lr_0 = 9.9971e-04
Validation auc = 0.711280
Epoch 996
Loss = 2.4276e-02, PNorm = 267.7261, GNorm = 0.3677, lr_0 = 9.9971e-04
Validation auc = 0.714703
Epoch 997
Loss = 4.3867e-02, PNorm = 267.9311, GNorm = 0.1730, lr_0 = 9.9971e-04
Validation auc = 0.711860
Epoch 998
Loss = 1.1504e-02, PNorm = 268.1053, GNorm = 1.5359, lr_0 = 9.9970e-04
Validation auc = 0.722552
Epoch 999
Loss = 2.5937e-03, PNorm = 268.2695, GNorm = 0.1381, lr_0 = 9.9970e-04
Loss = 4.6405e-02, PNorm = 268.4577, GNorm = 0.1153, lr_0 = 9.9970e-04
Validation auc = 0.715292
Epoch 1000
Loss = 1.0007e-01, PNorm = 268.6347, GNorm = 0.5763, lr_0 = 9.9970e-04
Validation auc = 0.714479
Epoch 1001
Loss = 3.0754e-02, PNorm = 268.8438, GNorm = 0.6036, lr_0 = 9.9970e-04
Validation auc = 0.710471
Epoch 1002
Loss = 6.0375e-02, PNorm = 269.0156, GNorm = 2.6464, lr_0 = 9.9970e-04
Validation auc = 0.702160
Epoch 1003
Loss = 4.0908e-02, PNorm = 269.1659, GNorm = 0.8510, lr_0 = 9.9970e-04
Validation auc = 0.698008
Epoch 1004
Loss = 3.9296e-02, PNorm = 269.3096, GNorm = 0.1085, lr_0 = 9.9970e-04
Validation auc = 0.720410
Epoch 1005
Loss = 1.0147e-02, PNorm = 269.4453, GNorm = 0.3957, lr_0 = 9.9970e-04
Validation auc = 0.744691
Epoch 1006
Loss = 5.9142e-02, PNorm = 269.6452, GNorm = 0.6674, lr_0 = 9.9970e-04
Validation auc = 0.700997
Epoch 1007
Loss = 1.6628e-02, PNorm = 269.9806, GNorm = 0.9345, lr_0 = 9.9970e-04
Validation auc = 0.691426
Epoch 1008
Loss = 2.3500e-02, PNorm = 270.3142, GNorm = 0.3424, lr_0 = 9.9970e-04
Validation auc = 0.695938
Epoch 1009
Loss = 4.9776e-02, PNorm = 270.5736, GNorm = 1.3356, lr_0 = 9.9970e-04
Loss = 3.1811e-02, PNorm = 270.7560, GNorm = 0.7542, lr_0 = 9.9970e-04
Validation auc = 0.700740
Epoch 1010
Loss = 5.4138e-02, PNorm = 270.9197, GNorm = 0.8608, lr_0 = 9.9969e-04
Validation auc = 0.706744
Epoch 1011
Loss = 5.9844e-02, PNorm = 271.0763, GNorm = 0.1199, lr_0 = 9.9969e-04
Validation auc = 0.706489
Epoch 1012
Loss = 4.7530e-02, PNorm = 271.2063, GNorm = 0.0621, lr_0 = 9.9969e-04
Validation auc = 0.705545
Epoch 1013
Loss = 9.7468e-02, PNorm = 271.3377, GNorm = 0.5641, lr_0 = 9.9969e-04
Validation auc = 0.715203
Epoch 1014
Loss = 7.5664e-02, PNorm = 271.4989, GNorm = 3.0925, lr_0 = 9.9969e-04
Validation auc = 0.710064
Epoch 1015
Loss = 4.3963e-01, PNorm = 271.7297, GNorm = 2.9160, lr_0 = 9.9969e-04
Validation auc = 0.710655
Epoch 1016
Loss = 3.6962e-02, PNorm = 272.0924, GNorm = 0.7391, lr_0 = 9.9969e-04
Validation auc = 0.700761
Epoch 1017
Loss = 8.2880e-02, PNorm = 272.3892, GNorm = 4.4022, lr_0 = 9.9969e-04
Validation auc = 0.688377
Epoch 1018
Loss = 9.3953e-02, PNorm = 272.6843, GNorm = 0.5436, lr_0 = 9.9969e-04
Validation auc = 0.699739
Epoch 1019
Loss = 2.2680e-02, PNorm = 272.9362, GNorm = 0.6828, lr_0 = 9.9969e-04
Loss = 5.4849e-02, PNorm = 273.1441, GNorm = 2.3514, lr_0 = 9.9969e-04
Validation auc = 0.720426
Epoch 1020
Loss = 5.9974e-02, PNorm = 273.3668, GNorm = 1.5558, lr_0 = 9.9969e-04
Validation auc = 0.717996
Epoch 1021
Loss = 8.6687e-02, PNorm = 273.5590, GNorm = 1.1448, lr_0 = 9.9969e-04
Validation auc = 0.711697
Epoch 1022
Loss = 4.8644e-02, PNorm = 273.7738, GNorm = 0.1394, lr_0 = 9.9969e-04
Validation auc = 0.694623
Epoch 1023
Loss = 2.0399e-02, PNorm = 273.9895, GNorm = 1.0002, lr_0 = 9.9969e-04
Validation auc = 0.683800
Epoch 1024
Loss = 2.0284e-02, PNorm = 274.1785, GNorm = 1.6906, lr_0 = 9.9968e-04
Validation auc = 0.698182
Epoch 1025
Loss = 1.3139e-01, PNorm = 274.3381, GNorm = 3.9687, lr_0 = 9.9968e-04
Validation auc = 0.680249
Epoch 1026
Loss = 8.8270e-02, PNorm = 274.5308, GNorm = 3.0498, lr_0 = 9.9968e-04
Validation auc = 0.691767
Epoch 1027
Loss = 2.4707e-02, PNorm = 274.7562, GNorm = 0.1381, lr_0 = 9.9968e-04
Validation auc = 0.718209
Epoch 1028
Loss = 2.6125e-02, PNorm = 274.9386, GNorm = 1.9199, lr_0 = 9.9968e-04
Validation auc = 0.723503
Epoch 1029
Loss = 2.8788e-02, PNorm = 275.0862, GNorm = 0.6965, lr_0 = 9.9968e-04
Loss = 3.3340e-02, PNorm = 275.2340, GNorm = 0.3715, lr_0 = 9.9968e-04
Validation auc = 0.713549
Epoch 1030
Loss = 1.9806e-02, PNorm = 275.3470, GNorm = 1.6940, lr_0 = 9.9968e-04
Validation auc = 0.708301
Epoch 1031
Loss = 1.1026e-01, PNorm = 275.4768, GNorm = 2.2175, lr_0 = 9.9968e-04
Validation auc = 0.705793
Epoch 1032
Loss = 2.8088e-02, PNorm = 275.6645, GNorm = 1.1789, lr_0 = 9.9968e-04
Validation auc = 0.717514
Epoch 1033
Loss = 8.7163e-02, PNorm = 275.8851, GNorm = 0.7580, lr_0 = 9.9968e-04
Validation auc = 0.724872
Epoch 1034
Loss = 2.7432e-01, PNorm = 276.1111, GNorm = 0.9913, lr_0 = 9.9968e-04
Validation auc = 0.712018
Epoch 1035
Loss = 8.1544e-02, PNorm = 276.3989, GNorm = 1.7172, lr_0 = 9.9968e-04
Validation auc = 0.713276
Epoch 1036
Loss = 2.2791e-02, PNorm = 276.6284, GNorm = 0.9454, lr_0 = 9.9968e-04
Validation auc = 0.719775
Epoch 1037
Loss = 6.8524e-02, PNorm = 276.8309, GNorm = 2.1696, lr_0 = 9.9968e-04
Validation auc = 0.711023
Epoch 1038
Loss = 6.8809e-02, PNorm = 277.0375, GNorm = 2.0592, lr_0 = 9.9967e-04
Validation auc = 0.698216
Epoch 1039
Loss = 3.1956e-02, PNorm = 277.2851, GNorm = 1.3042, lr_0 = 9.9967e-04
Loss = 2.4670e-02, PNorm = 277.4981, GNorm = 0.4189, lr_0 = 9.9967e-04
Validation auc = 0.703639
Epoch 1040
Loss = 2.8199e-02, PNorm = 277.6617, GNorm = 1.9425, lr_0 = 9.9967e-04
Validation auc = 0.707215
Epoch 1041
Loss = 4.4195e-02, PNorm = 277.7822, GNorm = 0.6295, lr_0 = 9.9967e-04
Validation auc = 0.712656
Epoch 1042
Loss = 1.5711e-02, PNorm = 277.9150, GNorm = 1.6177, lr_0 = 9.9967e-04
Validation auc = 0.714880
Epoch 1043
Loss = 7.2215e-02, PNorm = 278.0598, GNorm = 0.4551, lr_0 = 9.9967e-04
Validation auc = 0.713502
Epoch 1044
Loss = 4.1815e-02, PNorm = 278.2245, GNorm = 2.9088, lr_0 = 9.9967e-04
Validation auc = 0.709550
Epoch 1045
Loss = 6.8731e-03, PNorm = 278.4129, GNorm = 0.0593, lr_0 = 9.9967e-04
Validation auc = 0.712557
Epoch 1046
Loss = 1.8815e-02, PNorm = 278.5604, GNorm = 0.0138, lr_0 = 9.9967e-04
Validation auc = 0.709057
Epoch 1047
Loss = 8.5079e-03, PNorm = 278.6936, GNorm = 0.4672, lr_0 = 9.9967e-04
Validation auc = 0.699421
Epoch 1048
Loss = 2.6500e-02, PNorm = 278.8201, GNorm = 1.5989, lr_0 = 9.9967e-04
Validation auc = 0.701116
Epoch 1049
Loss = 3.8686e-02, PNorm = 278.9496, GNorm = 0.5728, lr_0 = 9.9967e-04
Loss = 5.0363e-02, PNorm = 279.0935, GNorm = 1.9287, lr_0 = 9.9967e-04
Validation auc = 0.716980
Epoch 1050
Loss = 6.0519e-02, PNorm = 279.2404, GNorm = 1.5247, lr_0 = 9.9966e-04
Validation auc = 0.719953
Epoch 1051
Loss = 4.5338e-02, PNorm = 279.3922, GNorm = 0.2401, lr_0 = 9.9966e-04
Validation auc = 0.722512
Epoch 1052
Loss = 5.4303e-02, PNorm = 279.5407, GNorm = 1.5769, lr_0 = 9.9966e-04
Validation auc = 0.707611
Epoch 1053
Loss = 5.9129e-03, PNorm = 279.6785, GNorm = 0.2746, lr_0 = 9.9966e-04
Validation auc = 0.696099
Epoch 1054
Loss = 1.4455e-02, PNorm = 279.8102, GNorm = 0.3119, lr_0 = 9.9966e-04
Validation auc = 0.700183
Epoch 1055
Loss = 4.6029e-02, PNorm = 279.9415, GNorm = 0.1631, lr_0 = 9.9966e-04
Validation auc = 0.704523
Epoch 1056
Loss = 9.8237e-02, PNorm = 280.1020, GNorm = 2.8801, lr_0 = 9.9966e-04
Validation auc = 0.705672
Epoch 1057
Loss = 2.2052e-02, PNorm = 280.2938, GNorm = 0.3021, lr_0 = 9.9966e-04
Validation auc = 0.706553
Epoch 1058
Loss = 4.1330e-02, PNorm = 280.4594, GNorm = 0.8840, lr_0 = 9.9966e-04
Validation auc = 0.714280
Epoch 1059
Loss = 1.9905e-02, PNorm = 280.6249, GNorm = 0.5844, lr_0 = 9.9966e-04
Loss = 3.3895e-02, PNorm = 280.7653, GNorm = 0.1245, lr_0 = 9.9966e-04
Validation auc = 0.718621
Epoch 1060
Loss = 3.0100e-02, PNorm = 280.9026, GNorm = 1.1637, lr_0 = 9.9966e-04
Validation auc = 0.731298
Epoch 1061
Loss = 1.1524e-01, PNorm = 281.0644, GNorm = 11.3046, lr_0 = 9.9966e-04
Validation auc = 0.739430
Epoch 1062
Loss = 9.1334e-02, PNorm = 281.4225, GNorm = 0.8525, lr_0 = 9.9966e-04
Validation auc = 0.725983
Epoch 1063
Loss = 7.5017e-02, PNorm = 281.7356, GNorm = 1.2786, lr_0 = 9.9966e-04
Validation auc = 0.731921
Epoch 1064
Loss = 2.7843e-02, PNorm = 281.9606, GNorm = 0.6260, lr_0 = 9.9965e-04
Validation auc = 0.718748
Epoch 1065
Loss = 7.4413e-02, PNorm = 282.1783, GNorm = 0.5336, lr_0 = 9.9965e-04
Validation auc = 0.710091
Epoch 1066
Loss = 3.2964e-02, PNorm = 282.3739, GNorm = 1.0117, lr_0 = 9.9965e-04
Validation auc = 0.714781
Epoch 1067
Loss = 8.8883e-03, PNorm = 282.5227, GNorm = 0.1899, lr_0 = 9.9965e-04
Validation auc = 0.722963
Epoch 1068
Loss = 2.1794e-02, PNorm = 282.6749, GNorm = 0.6475, lr_0 = 9.9965e-04
Validation auc = 0.740961
Epoch 1069
Loss = 3.7872e-02, PNorm = 282.7965, GNorm = 0.9620, lr_0 = 9.9965e-04
Loss = 1.5554e-02, PNorm = 282.9091, GNorm = 0.9797, lr_0 = 9.9965e-04
Validation auc = 0.749806
Epoch 1070
Loss = 2.1513e-02, PNorm = 283.0048, GNorm = 0.0962, lr_0 = 9.9965e-04
Validation auc = 0.751416
Epoch 1071
Loss = 3.4654e-02, PNorm = 283.0942, GNorm = 0.5215, lr_0 = 9.9965e-04
Validation auc = 0.746700
Epoch 1072
Loss = 5.7274e-02, PNorm = 283.2215, GNorm = 4.2718, lr_0 = 9.9965e-04
Validation auc = 0.751659
Epoch 1073
Loss = 1.7238e-02, PNorm = 283.3527, GNorm = 0.3542, lr_0 = 9.9965e-04
Validation auc = 0.756746
Epoch 1074
Loss = 5.7931e-02, PNorm = 283.4815, GNorm = 8.1788, lr_0 = 9.9965e-04
Validation auc = 0.738900
Epoch 1075
Loss = 6.6432e-02, PNorm = 283.6591, GNorm = 2.4784, lr_0 = 9.9965e-04
Validation auc = 0.713892
Epoch 1076
Loss = 9.9854e-02, PNorm = 283.8554, GNorm = 2.4795, lr_0 = 9.9965e-04
Validation auc = 0.724630
Epoch 1077
Loss = 4.2155e-02, PNorm = 284.0387, GNorm = 0.2454, lr_0 = 9.9964e-04
Validation auc = 0.735461
Epoch 1078
Loss = 3.2078e-02, PNorm = 284.1949, GNorm = 1.4201, lr_0 = 9.9964e-04
Validation auc = 0.745647
Epoch 1079
Loss = 1.5247e-02, PNorm = 284.3262, GNorm = 0.4554, lr_0 = 9.9964e-04
Loss = 4.9000e-02, PNorm = 284.4600, GNorm = 0.2769, lr_0 = 9.9964e-04
Validation auc = 0.737543
Epoch 1080
Loss = 4.4417e-02, PNorm = 284.5877, GNorm = 0.1722, lr_0 = 9.9964e-04
Validation auc = 0.720656
Epoch 1081
Loss = 9.0416e-02, PNorm = 284.7677, GNorm = 0.8775, lr_0 = 9.9964e-04
Validation auc = 0.731058
Epoch 1082
Loss = 4.3608e-02, PNorm = 284.9402, GNorm = 2.9700, lr_0 = 9.9964e-04
Validation auc = 0.732523
Epoch 1083
Loss = 1.6344e-02, PNorm = 285.1350, GNorm = 1.2907, lr_0 = 9.9964e-04
Validation auc = 0.725783
Epoch 1084
Loss = 2.4993e-02, PNorm = 285.2777, GNorm = 1.9623, lr_0 = 9.9964e-04
Validation auc = 0.728561
Epoch 1085
Loss = 7.5851e-02, PNorm = 285.4416, GNorm = 2.6391, lr_0 = 9.9964e-04
Validation auc = 0.730849
Epoch 1086
Loss = 1.3489e-02, PNorm = 285.6126, GNorm = 0.0817, lr_0 = 9.9964e-04
Validation auc = 0.722947
Epoch 1087
Loss = 2.9749e-02, PNorm = 285.7513, GNorm = 3.3259, lr_0 = 9.9964e-04
Validation auc = 0.730969
Epoch 1088
Loss = 2.0297e-01, PNorm = 285.9022, GNorm = 2.4001, lr_0 = 9.9964e-04
Validation auc = 0.727005
Epoch 1089
Loss = 6.1051e-03, PNorm = 286.0514, GNorm = 0.2326, lr_0 = 9.9964e-04
Loss = 3.2481e-02, PNorm = 286.1721, GNorm = 0.4205, lr_0 = 9.9964e-04
Validation auc = 0.726187
Epoch 1090
Loss = 9.2291e-02, PNorm = 286.3125, GNorm = 2.9897, lr_0 = 9.9963e-04
Validation auc = 0.721267
Epoch 1091
Loss = 7.6238e-02, PNorm = 286.4769, GNorm = 2.7531, lr_0 = 9.9963e-04
Validation auc = 0.720655
Epoch 1092
Loss = 3.0109e-02, PNorm = 286.6227, GNorm = 0.3155, lr_0 = 9.9963e-04
Validation auc = 0.728429
Epoch 1093
Loss = 1.4634e-02, PNorm = 286.7453, GNorm = 2.0344, lr_0 = 9.9963e-04
Validation auc = 0.732776
Epoch 1094
Loss = 5.3279e-02, PNorm = 286.8518, GNorm = 0.0397, lr_0 = 9.9963e-04
Validation auc = 0.731220
Epoch 1095
Loss = 2.7967e-02, PNorm = 286.9792, GNorm = 0.1318, lr_0 = 9.9963e-04
Validation auc = 0.722822
Epoch 1096
Loss = 8.7382e-02, PNorm = 287.1138, GNorm = 0.7583, lr_0 = 9.9963e-04
Validation auc = 0.718413
Epoch 1097
Loss = 3.0424e-02, PNorm = 287.3207, GNorm = 0.6958, lr_0 = 9.9963e-04
Validation auc = 0.720489
Epoch 1098
Loss = 4.2933e-02, PNorm = 287.5371, GNorm = 0.0466, lr_0 = 9.9963e-04
Validation auc = 0.732265
Epoch 1099
Loss = 1.0246e-03, PNorm = 287.7407, GNorm = 0.0616, lr_0 = 9.9963e-04
Loss = 7.6790e-02, PNorm = 287.9323, GNorm = 1.4137, lr_0 = 9.9963e-04
Validation auc = 0.702513
Epoch 1100
Loss = 3.5317e-02, PNorm = 288.1283, GNorm = 1.3444, lr_0 = 9.9963e-04
Validation auc = 0.702501
Epoch 1101
Loss = 4.5378e-02, PNorm = 288.3021, GNorm = 0.9855, lr_0 = 9.9963e-04
Validation auc = 0.729364
Epoch 1102
Loss = 3.6939e-02, PNorm = 288.4478, GNorm = 1.2972, lr_0 = 9.9963e-04
Validation auc = 0.735518
Epoch 1103
Loss = 8.0207e-02, PNorm = 288.6032, GNorm = 2.5129, lr_0 = 9.9962e-04
Validation auc = 0.741088
Epoch 1104
Loss = 6.2700e-02, PNorm = 288.8344, GNorm = 0.4500, lr_0 = 9.9962e-04
Validation auc = 0.713955
Epoch 1105
Loss = 6.1031e-02, PNorm = 289.0607, GNorm = 0.2318, lr_0 = 9.9962e-04
Validation auc = 0.727047
Epoch 1106
Loss = 5.7876e-02, PNorm = 289.2775, GNorm = 0.4303, lr_0 = 9.9962e-04
Validation auc = 0.737351
Epoch 1107
Loss = 3.3769e-02, PNorm = 289.4716, GNorm = 0.3248, lr_0 = 9.9962e-04
Validation auc = 0.749044
Epoch 1108
Loss = 7.3067e-03, PNorm = 289.6248, GNorm = 0.3414, lr_0 = 9.9962e-04
Validation auc = 0.742728
Epoch 1109
Loss = 2.5999e-02, PNorm = 289.7541, GNorm = 0.8175, lr_0 = 9.9962e-04
Loss = 6.5584e-02, PNorm = 289.8922, GNorm = 1.0573, lr_0 = 9.9962e-04
Validation auc = 0.744588
Epoch 1110
Loss = 7.7597e-02, PNorm = 290.0523, GNorm = 1.1316, lr_0 = 9.9962e-04
Validation auc = 0.740398
Epoch 1111
Loss = 4.1317e-02, PNorm = 290.1966, GNorm = 0.2390, lr_0 = 9.9962e-04
Validation auc = 0.738325
Epoch 1112
Loss = 5.7474e-02, PNorm = 290.3506, GNorm = 2.0635, lr_0 = 9.9962e-04
Validation auc = 0.751279
Epoch 1113
Loss = 6.6027e-02, PNorm = 290.4932, GNorm = 2.6274, lr_0 = 9.9962e-04
Validation auc = 0.744419
Epoch 1114
Loss = 3.5691e-02, PNorm = 290.6454, GNorm = 1.0984, lr_0 = 9.9962e-04
Validation auc = 0.735776
Epoch 1115
Loss = 2.7951e-02, PNorm = 290.8095, GNorm = 0.5742, lr_0 = 9.9962e-04
Validation auc = 0.742910
Epoch 1116
Loss = 1.4919e-02, PNorm = 290.9597, GNorm = 0.8758, lr_0 = 9.9962e-04
Validation auc = 0.744919
Epoch 1117
Loss = 2.5862e-02, PNorm = 291.0660, GNorm = 0.1012, lr_0 = 9.9961e-04
Validation auc = 0.731436
Epoch 1118
Loss = 8.5899e-03, PNorm = 291.1698, GNorm = 0.1710, lr_0 = 9.9961e-04
Validation auc = 0.739424
Epoch 1119
Loss = 1.9477e-02, PNorm = 291.2969, GNorm = 0.5235, lr_0 = 9.9961e-04
Loss = 3.2410e-02, PNorm = 291.4282, GNorm = 1.0496, lr_0 = 9.9961e-04
Validation auc = 0.741298
Epoch 1120
Loss = 3.6541e-02, PNorm = 291.5438, GNorm = 0.6405, lr_0 = 9.9961e-04
Validation auc = 0.730493
Epoch 1121
Loss = 7.3425e-03, PNorm = 291.6411, GNorm = 0.3724, lr_0 = 9.9961e-04
Validation auc = 0.726752
Epoch 1122
Loss = 6.0715e-02, PNorm = 291.7283, GNorm = 0.5746, lr_0 = 9.9961e-04
Validation auc = 0.729764
Epoch 1123
Loss = 1.5343e-01, PNorm = 291.8666, GNorm = 0.1136, lr_0 = 9.9961e-04
Validation auc = 0.712642
Epoch 1124
Loss = 4.8609e-02, PNorm = 292.0739, GNorm = 1.4271, lr_0 = 9.9961e-04
Validation auc = 0.717578
Epoch 1125
Loss = 5.0135e-02, PNorm = 292.2791, GNorm = 1.7227, lr_0 = 9.9961e-04
Validation auc = 0.719733
Epoch 1126
Loss = 5.8153e-02, PNorm = 292.4610, GNorm = 0.2887, lr_0 = 9.9961e-04
Validation auc = 0.714604
Epoch 1127
Loss = 1.7231e-02, PNorm = 292.6123, GNorm = 0.1446, lr_0 = 9.9961e-04
Validation auc = 0.705619
Epoch 1128
Loss = 2.0729e-03, PNorm = 292.7396, GNorm = 0.0250, lr_0 = 9.9961e-04
Validation auc = 0.712700
Epoch 1129
Loss = 2.6115e-01, PNorm = 292.8926, GNorm = 2.6496, lr_0 = 9.9961e-04
Loss = 4.2847e-02, PNorm = 293.0184, GNorm = 3.6686, lr_0 = 9.9960e-04
Validation auc = 0.733950
Epoch 1130
Loss = 4.8730e-02, PNorm = 293.1614, GNorm = 0.6075, lr_0 = 9.9960e-04
Validation auc = 0.740022
Epoch 1131
Loss = 3.1460e-02, PNorm = 293.2982, GNorm = 0.0270, lr_0 = 9.9960e-04
Validation auc = 0.725951
Epoch 1132
Loss = 2.3830e-02, PNorm = 293.4177, GNorm = 0.1666, lr_0 = 9.9960e-04
Validation auc = 0.730911
Epoch 1133
Loss = 2.0793e-02, PNorm = 293.5273, GNorm = 2.1785, lr_0 = 9.9960e-04
Validation auc = 0.727047
Epoch 1134
Loss = 6.7298e-02, PNorm = 293.6817, GNorm = 2.5308, lr_0 = 9.9960e-04
Validation auc = 0.752016
Epoch 1135
Loss = 7.2935e-02, PNorm = 293.8811, GNorm = 1.6040, lr_0 = 9.9960e-04
Validation auc = 0.735292
Epoch 1136
Loss = 2.3355e-02, PNorm = 294.1151, GNorm = 0.4915, lr_0 = 9.9960e-04
Validation auc = 0.732741
Epoch 1137
Loss = 2.2107e-02, PNorm = 294.3084, GNorm = 1.0161, lr_0 = 9.9960e-04
Validation auc = 0.733008
Epoch 1138
Loss = 1.6491e-02, PNorm = 294.4568, GNorm = 0.2174, lr_0 = 9.9960e-04
Validation auc = 0.718427
Epoch 1139
Loss = 3.9896e-03, PNorm = 294.5943, GNorm = 0.1786, lr_0 = 9.9960e-04
Loss = 4.6168e-02, PNorm = 294.7127, GNorm = 0.1553, lr_0 = 9.9960e-04
Validation auc = 0.733651
Epoch 1140
Loss = 1.4664e-01, PNorm = 294.9023, GNorm = 1.0693, lr_0 = 9.9960e-04
Validation auc = 0.713090
Epoch 1141
Loss = 7.0422e-02, PNorm = 295.1511, GNorm = 0.1654, lr_0 = 9.9960e-04
Validation auc = 0.714364
Epoch 1142
Loss = 5.5431e-02, PNorm = 295.3535, GNorm = 0.0720, lr_0 = 9.9960e-04
Validation auc = 0.724296
Epoch 1143
Loss = 2.4684e-02, PNorm = 295.4973, GNorm = 1.3497, lr_0 = 9.9959e-04
Validation auc = 0.729341
Epoch 1144
Loss = 5.7617e-02, PNorm = 295.6306, GNorm = 0.6621, lr_0 = 9.9959e-04
Validation auc = 0.735195
Epoch 1145
Loss = 6.6960e-02, PNorm = 295.7470, GNorm = 1.2499, lr_0 = 9.9959e-04
Validation auc = 0.736479
Epoch 1146
Loss = 5.0612e-02, PNorm = 295.8436, GNorm = 1.4821, lr_0 = 9.9959e-04
Validation auc = 0.742640
Epoch 1147
Loss = 2.9548e-02, PNorm = 295.9643, GNorm = 1.2634, lr_0 = 9.9959e-04
Validation auc = 0.736772
Epoch 1148
Loss = 8.6990e-03, PNorm = 296.0790, GNorm = 0.3402, lr_0 = 9.9959e-04
Validation auc = 0.742296
Epoch 1149
Loss = 2.4755e-03, PNorm = 296.1726, GNorm = 0.1160, lr_0 = 9.9959e-04
Loss = 3.0318e-02, PNorm = 296.2524, GNorm = 1.5734, lr_0 = 9.9959e-04
Validation auc = 0.742952
Epoch 1150
Loss = 5.1248e-02, PNorm = 296.3552, GNorm = 0.1375, lr_0 = 9.9959e-04
Validation auc = 0.712917
Epoch 1151
Loss = 2.9411e-02, PNorm = 296.4816, GNorm = 0.2217, lr_0 = 9.9959e-04
Validation auc = 0.715783
Epoch 1152
Loss = 3.5658e-02, PNorm = 296.5861, GNorm = 0.6806, lr_0 = 9.9959e-04
Validation auc = 0.724522
Epoch 1153
Loss = 5.7141e-02, PNorm = 296.6883, GNorm = 0.3683, lr_0 = 9.9959e-04
Validation auc = 0.731334
Epoch 1154
Loss = 5.1267e-02, PNorm = 296.8092, GNorm = 0.1175, lr_0 = 9.9959e-04
Validation auc = 0.708168
Epoch 1155
Loss = 1.5777e-02, PNorm = 296.9413, GNorm = 0.0530, lr_0 = 9.9959e-04
Validation auc = 0.709127
Epoch 1156
Loss = 3.3043e-02, PNorm = 297.0647, GNorm = 0.1168, lr_0 = 9.9958e-04
Validation auc = 0.711236
Epoch 1157
Loss = 4.2051e-02, PNorm = 297.1960, GNorm = 1.0906, lr_0 = 9.9958e-04
Validation auc = 0.706715
Epoch 1158
Loss = 3.1370e-02, PNorm = 297.3424, GNorm = 0.4592, lr_0 = 9.9958e-04
Validation auc = 0.707231
Epoch 1159
Loss = 2.4336e-02, PNorm = 297.4601, GNorm = 0.5992, lr_0 = 9.9958e-04
Loss = 5.0223e-02, PNorm = 297.5723, GNorm = 2.5357, lr_0 = 9.9958e-04
Validation auc = 0.731783
Epoch 1160
Loss = 4.9573e-02, PNorm = 297.7261, GNorm = 0.3294, lr_0 = 9.9958e-04
Validation auc = 0.712440
Epoch 1161
Loss = 3.1111e-02, PNorm = 297.8613, GNorm = 0.4676, lr_0 = 9.9958e-04
Validation auc = 0.689756
Epoch 1162
Loss = 6.1860e-02, PNorm = 297.9958, GNorm = 0.1452, lr_0 = 9.9958e-04
Validation auc = 0.717061
Epoch 1163
Loss = 6.8416e-02, PNorm = 298.1545, GNorm = 0.9787, lr_0 = 9.9958e-04
Validation auc = 0.711114
Epoch 1164
Loss = 5.2428e-02, PNorm = 298.3193, GNorm = 2.0402, lr_0 = 9.9958e-04
Validation auc = 0.723727
Epoch 1165
Loss = 9.3004e-02, PNorm = 298.4819, GNorm = 2.9906, lr_0 = 9.9958e-04
Validation auc = 0.732396
Epoch 1166
Loss = 1.4964e-01, PNorm = 298.6509, GNorm = 1.2499, lr_0 = 9.9958e-04
Validation auc = 0.739463
Epoch 1167
Loss = 1.7591e-02, PNorm = 298.7992, GNorm = 0.6920, lr_0 = 9.9958e-04
Validation auc = 0.750161
Epoch 1168
Loss = 5.8903e-02, PNorm = 298.9362, GNorm = 1.0035, lr_0 = 9.9958e-04
Validation auc = 0.741444
Epoch 1169
Loss = 6.1868e-03, PNorm = 299.0782, GNorm = 0.1757, lr_0 = 9.9958e-04
Loss = 5.8610e-02, PNorm = 299.2683, GNorm = 2.0721, lr_0 = 9.9957e-04
Validation auc = 0.749279
Epoch 1170
Loss = 3.0063e-02, PNorm = 299.4548, GNorm = 0.8569, lr_0 = 9.9957e-04
Validation auc = 0.737323
Epoch 1171
Loss = 3.9882e-02, PNorm = 299.5959, GNorm = 1.2195, lr_0 = 9.9957e-04
Validation auc = 0.727918
Epoch 1172
Loss = 2.4954e-02, PNorm = 299.7277, GNorm = 2.2560, lr_0 = 9.9957e-04
Validation auc = 0.737871
Epoch 1173
Loss = 3.0053e-02, PNorm = 299.8460, GNorm = 0.1360, lr_0 = 9.9957e-04
Validation auc = 0.747978
Epoch 1174
Loss = 7.9233e-02, PNorm = 299.9621, GNorm = 0.6315, lr_0 = 9.9957e-04
Validation auc = 0.738015
Epoch 1175
Loss = 5.9180e-02, PNorm = 300.0957, GNorm = 2.3251, lr_0 = 9.9957e-04
Validation auc = 0.737990
Epoch 1176
Loss = 9.1699e-02, PNorm = 300.2638, GNorm = 0.9099, lr_0 = 9.9957e-04
Validation auc = 0.758880
Epoch 1177
Loss = 1.1188e-02, PNorm = 300.4135, GNorm = 0.5080, lr_0 = 9.9957e-04
Validation auc = 0.758771
Epoch 1178
Loss = 1.8106e-01, PNorm = 300.5279, GNorm = 4.7366, lr_0 = 9.9957e-04
Validation auc = 0.760899
Epoch 1179
Loss = 9.6411e-02, PNorm = 300.6680, GNorm = 2.1366, lr_0 = 9.9957e-04
Loss = 3.5198e-02, PNorm = 300.8193, GNorm = 0.0347, lr_0 = 9.9957e-04
Validation auc = 0.746276
Epoch 1180
Loss = 2.9413e-02, PNorm = 300.9636, GNorm = 0.0266, lr_0 = 9.9957e-04
Validation auc = 0.739149
Epoch 1181
Loss = 3.6267e-02, PNorm = 301.1032, GNorm = 1.1824, lr_0 = 9.9957e-04
Validation auc = 0.730902
Epoch 1182
Loss = 2.4195e-02, PNorm = 301.2369, GNorm = 1.9678, lr_0 = 9.9956e-04
Validation auc = 0.728660
Epoch 1183
Loss = 9.2262e-02, PNorm = 301.3441, GNorm = 1.4887, lr_0 = 9.9956e-04
Validation auc = 0.724424
Epoch 1184
Loss = 2.7872e-02, PNorm = 301.4807, GNorm = 0.5366, lr_0 = 9.9956e-04
Validation auc = 0.727009
Epoch 1185
Loss = 3.0953e-02, PNorm = 301.6548, GNorm = 0.7800, lr_0 = 9.9956e-04
Validation auc = 0.732297
Epoch 1186
Loss = 2.0796e-02, PNorm = 301.8122, GNorm = 1.0632, lr_0 = 9.9956e-04
Validation auc = 0.722327
Epoch 1187
Loss = 3.3742e-02, PNorm = 301.9607, GNorm = 0.4604, lr_0 = 9.9956e-04
Validation auc = 0.723977
Epoch 1188
Loss = 5.3081e-02, PNorm = 302.1120, GNorm = 1.8685, lr_0 = 9.9956e-04
Validation auc = 0.734204
Epoch 1189
Loss = 2.4889e-02, PNorm = 302.2645, GNorm = 0.5574, lr_0 = 9.9956e-04
Loss = 3.3376e-02, PNorm = 302.4147, GNorm = 0.4683, lr_0 = 9.9956e-04
Validation auc = 0.728655
Epoch 1190
Loss = 1.9864e-02, PNorm = 302.5574, GNorm = 0.3100, lr_0 = 9.9956e-04
Validation auc = 0.731343
Epoch 1191
Loss = 5.1011e-02, PNorm = 302.7050, GNorm = 0.0752, lr_0 = 9.9956e-04
Validation auc = 0.745260
Epoch 1192
Loss = 5.1292e-02, PNorm = 302.8884, GNorm = 4.1195, lr_0 = 9.9956e-04
Validation auc = 0.727999
Epoch 1193
Loss = 3.5682e-02, PNorm = 303.0673, GNorm = 0.6091, lr_0 = 9.9956e-04
Validation auc = 0.718780
Epoch 1194
Loss = 1.3279e-01, PNorm = 303.2345, GNorm = 4.9200, lr_0 = 9.9956e-04
Validation auc = 0.708220
Epoch 1195
Loss = 4.2575e-02, PNorm = 303.5035, GNorm = 0.8687, lr_0 = 9.9956e-04
Validation auc = 0.702144
Epoch 1196
Loss = 7.4960e-02, PNorm = 303.7721, GNorm = 0.7413, lr_0 = 9.9955e-04
Validation auc = 0.708235
Epoch 1197
Loss = 1.3366e-01, PNorm = 304.0090, GNorm = 3.6928, lr_0 = 9.9955e-04
Validation auc = 0.698689
Epoch 1198
Loss = 2.3838e-02, PNorm = 304.2368, GNorm = 0.7499, lr_0 = 9.9955e-04
Validation auc = 0.695288
Epoch 1199
Loss = 1.7251e-02, PNorm = 304.4541, GNorm = 0.4835, lr_0 = 9.9955e-04
Loss = 6.9044e-02, PNorm = 304.6950, GNorm = 0.1208, lr_0 = 9.9955e-04
Validation auc = 0.712491
Epoch 1200
Loss = 2.7904e-02, PNorm = 304.8959, GNorm = 3.5094, lr_0 = 9.9955e-04
Validation auc = 0.720295
Epoch 1201
Loss = 9.0747e-02, PNorm = 305.1353, GNorm = 1.7546, lr_0 = 9.9955e-04
Validation auc = 0.734752
Epoch 1202
Loss = 1.0078e-01, PNorm = 305.4174, GNorm = 0.9403, lr_0 = 9.9955e-04
Validation auc = 0.755935
Epoch 1203
Loss = 4.0334e-02, PNorm = 305.6836, GNorm = 0.5915, lr_0 = 9.9955e-04
Validation auc = 0.764799
Epoch 1204
Loss = 5.3786e-02, PNorm = 305.8950, GNorm = 2.3501, lr_0 = 9.9955e-04
Validation auc = 0.756272
Epoch 1205
Loss = 1.0524e-01, PNorm = 306.0917, GNorm = 3.4349, lr_0 = 9.9955e-04
Validation auc = 0.743898
Epoch 1206
Loss = 4.3393e-02, PNorm = 306.2824, GNorm = 0.4709, lr_0 = 9.9955e-04
Validation auc = 0.733484
Epoch 1207
Loss = 3.3165e-02, PNorm = 306.4802, GNorm = 0.2572, lr_0 = 9.9955e-04
Validation auc = 0.730267
Epoch 1208
Loss = 1.3516e-01, PNorm = 306.6236, GNorm = 1.2568, lr_0 = 9.9955e-04
Validation auc = 0.717044
Epoch 1209
Loss = 1.5577e-02, PNorm = 306.7518, GNorm = 0.8111, lr_0 = 9.9954e-04
Loss = 1.0019e-01, PNorm = 306.9082, GNorm = 4.5419, lr_0 = 9.9954e-04
Validation auc = 0.722895
Epoch 1210
Loss = 1.0765e-01, PNorm = 307.1609, GNorm = 2.2793, lr_0 = 9.9954e-04
Validation auc = 0.714254
Epoch 1211
Loss = 7.4411e-02, PNorm = 307.4931, GNorm = 2.4304, lr_0 = 9.9954e-04
Validation auc = 0.711646
Epoch 1212
Loss = 3.3121e-02, PNorm = 307.7605, GNorm = 3.7568, lr_0 = 9.9954e-04
Validation auc = 0.725664
Epoch 1213
Loss = 3.1234e-02, PNorm = 307.9716, GNorm = 1.5790, lr_0 = 9.9954e-04
Validation auc = 0.732374
Epoch 1214
Loss = 3.9128e-02, PNorm = 308.1394, GNorm = 0.2981, lr_0 = 9.9954e-04
Validation auc = 0.739926
Epoch 1215
Loss = 1.9705e-02, PNorm = 308.2730, GNorm = 0.2005, lr_0 = 9.9954e-04
Validation auc = 0.739672
Epoch 1216
Loss = 9.4606e-03, PNorm = 308.4096, GNorm = 0.2385, lr_0 = 9.9954e-04
Validation auc = 0.747324
Epoch 1217
Loss = 4.7687e-02, PNorm = 308.5263, GNorm = 0.3215, lr_0 = 9.9954e-04
Validation auc = 0.759766
Epoch 1218
Loss = 4.8206e-02, PNorm = 308.6691, GNorm = 0.3455, lr_0 = 9.9954e-04
Validation auc = 0.758616
Epoch 1219
Loss = 8.2286e-03, PNorm = 308.7962, GNorm = 0.4955, lr_0 = 9.9954e-04
Loss = 4.6571e-02, PNorm = 308.9235, GNorm = 1.6364, lr_0 = 9.9954e-04
Validation auc = 0.744484
Epoch 1220
Loss = 3.7018e-02, PNorm = 309.0458, GNorm = 0.4245, lr_0 = 9.9954e-04
Validation auc = 0.732195
Epoch 1221
Loss = 6.9514e-02, PNorm = 309.1717, GNorm = 0.1220, lr_0 = 9.9954e-04
Validation auc = 0.740726
Epoch 1222
Loss = 4.5677e-02, PNorm = 309.3074, GNorm = 0.4539, lr_0 = 9.9953e-04
Validation auc = 0.730865
Epoch 1223
Loss = 6.3453e-02, PNorm = 309.4243, GNorm = 2.0577, lr_0 = 9.9953e-04
Validation auc = 0.731536
Epoch 1224
Loss = 3.0341e-02, PNorm = 309.5416, GNorm = 0.6814, lr_0 = 9.9953e-04
Validation auc = 0.725592
Epoch 1225
Loss = 4.4825e-02, PNorm = 309.6581, GNorm = 0.5352, lr_0 = 9.9953e-04
Validation auc = 0.720752
Epoch 1226
Loss = 6.9031e-02, PNorm = 309.7978, GNorm = 1.1220, lr_0 = 9.9953e-04
Validation auc = 0.719433
Epoch 1227
Loss = 5.3434e-02, PNorm = 309.9740, GNorm = 0.9187, lr_0 = 9.9953e-04
Validation auc = 0.719501
Epoch 1228
Loss = 9.1916e-02, PNorm = 310.1541, GNorm = 1.4560, lr_0 = 9.9953e-04
Validation auc = 0.727397
Epoch 1229
Loss = 2.2333e-02, PNorm = 310.3128, GNorm = 0.9519, lr_0 = 9.9953e-04
Loss = 5.4194e-02, PNorm = 310.4702, GNorm = 1.1022, lr_0 = 9.9953e-04
Validation auc = 0.726980
Epoch 1230
Loss = 3.3146e-02, PNorm = 310.6248, GNorm = 1.7413, lr_0 = 9.9953e-04
Validation auc = 0.727040
Epoch 1231
Loss = 9.3783e-02, PNorm = 310.7771, GNorm = 6.5857, lr_0 = 9.9953e-04
Validation auc = 0.715711
Epoch 1232
Loss = 3.5754e-02, PNorm = 310.9619, GNorm = 1.2854, lr_0 = 9.9953e-04
Validation auc = 0.701996
Epoch 1233
Loss = 1.9235e-02, PNorm = 311.1299, GNorm = 0.0410, lr_0 = 9.9953e-04
Validation auc = 0.694168
Epoch 1234
Loss = 8.8927e-02, PNorm = 311.2491, GNorm = 3.0179, lr_0 = 9.9953e-04
Validation auc = 0.707755
Epoch 1235
Loss = 3.9087e-02, PNorm = 311.3839, GNorm = 0.6372, lr_0 = 9.9952e-04
Validation auc = 0.715854
Epoch 1236
Loss = 1.2828e-02, PNorm = 311.4955, GNorm = 0.5035, lr_0 = 9.9952e-04
Validation auc = 0.722847
Epoch 1237
Loss = 6.0211e-02, PNorm = 311.5916, GNorm = 2.4928, lr_0 = 9.9952e-04
Validation auc = 0.722564
Epoch 1238
Loss = 6.8480e-03, PNorm = 311.7285, GNorm = 0.3173, lr_0 = 9.9952e-04
Validation auc = 0.717251
Epoch 1239
Loss = 6.1770e-02, PNorm = 311.8892, GNorm = 3.5815, lr_0 = 9.9952e-04
Loss = 6.2651e-02, PNorm = 312.0314, GNorm = 0.2640, lr_0 = 9.9952e-04
Validation auc = 0.721551
Epoch 1240
Loss = 7.5256e-02, PNorm = 312.2002, GNorm = 1.3970, lr_0 = 9.9952e-04
Validation auc = 0.736126
Epoch 1241
Loss = 1.7793e-01, PNorm = 312.3932, GNorm = 4.8072, lr_0 = 9.9952e-04
Validation auc = 0.700353
Epoch 1242
Loss = 1.1427e-01, PNorm = 312.6701, GNorm = 1.2801, lr_0 = 9.9952e-04
Validation auc = 0.700322
Epoch 1243
Loss = 4.3144e-02, PNorm = 312.8947, GNorm = 0.6470, lr_0 = 9.9952e-04
Validation auc = 0.707846
Epoch 1244
Loss = 3.9772e-02, PNorm = 313.0417, GNorm = 2.6650, lr_0 = 9.9952e-04
Validation auc = 0.703689
Epoch 1245
Loss = 7.0323e-02, PNorm = 313.1448, GNorm = 3.2624, lr_0 = 9.9952e-04
Validation auc = 0.712886
Epoch 1246
Loss = 9.2609e-02, PNorm = 313.2520, GNorm = 0.4736, lr_0 = 9.9952e-04
Validation auc = 0.707152
Epoch 1247
Loss = 7.3556e-03, PNorm = 313.3666, GNorm = 0.3450, lr_0 = 9.9952e-04
Validation auc = 0.714709
Epoch 1248
Loss = 2.8217e-02, PNorm = 313.4682, GNorm = 1.7012, lr_0 = 9.9952e-04
Validation auc = 0.728633
Epoch 1249
Loss = 2.4495e-02, PNorm = 313.5611, GNorm = 0.9200, lr_0 = 9.9951e-04
Loss = 1.6838e-02, PNorm = 313.6422, GNorm = 2.2856, lr_0 = 9.9951e-04
Validation auc = 0.727898
Epoch 1250
Loss = 9.0067e-03, PNorm = 313.7139, GNorm = 0.4631, lr_0 = 9.9951e-04
Validation auc = 0.719657
Epoch 1251
Loss = 5.9199e-02, PNorm = 313.7858, GNorm = 1.7774, lr_0 = 9.9951e-04
Validation auc = 0.721764
Epoch 1252
Loss = 9.7644e-02, PNorm = 313.8751, GNorm = 0.6872, lr_0 = 9.9951e-04
Validation auc = 0.705786
Epoch 1253
Loss = 1.2426e-01, PNorm = 314.0545, GNorm = 0.4049, lr_0 = 9.9951e-04
Validation auc = 0.745195
Epoch 1254
Loss = 1.7858e-02, PNorm = 314.2752, GNorm = 0.5277, lr_0 = 9.9951e-04
Validation auc = 0.755060
Epoch 1255
Loss = 5.1697e-02, PNorm = 314.4591, GNorm = 0.0618, lr_0 = 9.9951e-04
Validation auc = 0.735963
Epoch 1256
Loss = 6.8493e-02, PNorm = 314.6449, GNorm = 3.4767, lr_0 = 9.9951e-04
Validation auc = 0.699806
Epoch 1257
Loss = 3.7958e-02, PNorm = 314.8236, GNorm = 1.2776, lr_0 = 9.9951e-04
Validation auc = 0.691270
Epoch 1258
Loss = 2.4464e-02, PNorm = 314.9843, GNorm = 0.3995, lr_0 = 9.9951e-04
Validation auc = 0.707173
Epoch 1259
Loss = 3.1643e-02, PNorm = 315.1774, GNorm = 0.7088, lr_0 = 9.9951e-04
Loss = 3.4192e-02, PNorm = 315.3688, GNorm = 0.4508, lr_0 = 9.9951e-04
Validation auc = 0.732620
Epoch 1260
Loss = 2.0168e-02, PNorm = 315.5086, GNorm = 1.2109, lr_0 = 9.9951e-04
Validation auc = 0.740435
Epoch 1261
Loss = 9.9371e-02, PNorm = 315.6514, GNorm = 1.7221, lr_0 = 9.9951e-04
Validation auc = 0.710176
Epoch 1262
Loss = 6.3498e-02, PNorm = 315.8499, GNorm = 1.7161, lr_0 = 9.9950e-04
Validation auc = 0.708136
Epoch 1263
Loss = 4.1197e-02, PNorm = 316.0460, GNorm = 2.3453, lr_0 = 9.9950e-04
Validation auc = 0.734903
Epoch 1264
Loss = 6.0174e-02, PNorm = 316.2673, GNorm = 1.3917, lr_0 = 9.9950e-04
Validation auc = 0.722367
Epoch 1265
Loss = 1.1634e-01, PNorm = 316.5079, GNorm = 0.5371, lr_0 = 9.9950e-04
Validation auc = 0.723754
Epoch 1266
Loss = 1.6983e-02, PNorm = 316.7857, GNorm = 0.6550, lr_0 = 9.9950e-04
Validation auc = 0.736553
Epoch 1267
Loss = 2.6211e-02, PNorm = 316.9964, GNorm = 0.0451, lr_0 = 9.9950e-04
Validation auc = 0.732061
Epoch 1268
Loss = 2.2307e-02, PNorm = 317.1973, GNorm = 0.9855, lr_0 = 9.9950e-04
Validation auc = 0.723584
Epoch 1269
Loss = 4.4209e-02, PNorm = 317.4036, GNorm = 0.7962, lr_0 = 9.9950e-04
Loss = 7.1587e-02, PNorm = 317.5978, GNorm = 2.9146, lr_0 = 9.9950e-04
Validation auc = 0.706212
Epoch 1270
Loss = 5.5887e-02, PNorm = 317.7886, GNorm = 0.6957, lr_0 = 9.9950e-04
Validation auc = 0.700485
Epoch 1271
Loss = 6.1415e-02, PNorm = 317.9665, GNorm = 2.2006, lr_0 = 9.9950e-04
Validation auc = 0.706826
Epoch 1272
Loss = 7.1551e-02, PNorm = 318.1257, GNorm = 0.3506, lr_0 = 9.9950e-04
Validation auc = 0.725290
Epoch 1273
Loss = 2.9538e-02, PNorm = 318.2753, GNorm = 0.1299, lr_0 = 9.9950e-04
Validation auc = 0.728252
Epoch 1274
Loss = 4.5950e-02, PNorm = 318.3979, GNorm = 0.1082, lr_0 = 9.9950e-04
Validation auc = 0.712730
Epoch 1275
Loss = 3.8326e-02, PNorm = 318.5126, GNorm = 0.5769, lr_0 = 9.9949e-04
Validation auc = 0.724093
Epoch 1276
Loss = 1.0839e-01, PNorm = 318.6466, GNorm = 3.7683, lr_0 = 9.9949e-04
Validation auc = 0.722276
Epoch 1277
Loss = 2.5079e-02, PNorm = 318.7898, GNorm = 0.7673, lr_0 = 9.9949e-04
Validation auc = 0.725735
Epoch 1278
Loss = 8.5751e-03, PNorm = 318.9190, GNorm = 0.3165, lr_0 = 9.9949e-04
Validation auc = 0.726589
Epoch 1279
Loss = 5.1194e-03, PNorm = 319.0133, GNorm = 0.1723, lr_0 = 9.9949e-04
Loss = 3.8459e-02, PNorm = 319.1220, GNorm = 0.4388, lr_0 = 9.9949e-04
Validation auc = 0.727919
Epoch 1280
Loss = 2.9499e-02, PNorm = 319.2483, GNorm = 0.5352, lr_0 = 9.9949e-04
Validation auc = 0.727188
Epoch 1281
Loss = 4.5227e-02, PNorm = 319.3721, GNorm = 0.2626, lr_0 = 9.9949e-04
Validation auc = 0.723207
Epoch 1282
Loss = 3.5670e-02, PNorm = 319.4849, GNorm = 0.0916, lr_0 = 9.9949e-04
Validation auc = 0.706665
Epoch 1283
Loss = 8.0545e-02, PNorm = 319.6180, GNorm = 2.7932, lr_0 = 9.9949e-04
Validation auc = 0.721754
Epoch 1284
Loss = 3.2142e-02, PNorm = 319.7616, GNorm = 1.6010, lr_0 = 9.9949e-04
Validation auc = 0.723430
Epoch 1285
Loss = 3.1889e-02, PNorm = 319.8859, GNorm = 0.2159, lr_0 = 9.9949e-04
Validation auc = 0.739640
Epoch 1286
Loss = 3.8919e-02, PNorm = 320.0362, GNorm = 4.3571, lr_0 = 9.9949e-04
Validation auc = 0.745079
Epoch 1287
Loss = 6.5806e-02, PNorm = 320.2719, GNorm = 2.7518, lr_0 = 9.9949e-04
Validation auc = 0.737646
Epoch 1288
Loss = 5.4212e-02, PNorm = 320.4925, GNorm = 2.8383, lr_0 = 9.9949e-04
Validation auc = 0.723281
Epoch 1289
Loss = 1.2388e-02, PNorm = 320.7181, GNorm = 0.2898, lr_0 = 9.9948e-04
Loss = 9.6077e-02, PNorm = 320.9445, GNorm = 2.3228, lr_0 = 9.9948e-04
Validation auc = 0.729731
Epoch 1290
Loss = 6.4072e-02, PNorm = 321.1700, GNorm = 0.0936, lr_0 = 9.9948e-04
Validation auc = 0.755568
Epoch 1291
Loss = 3.7513e-02, PNorm = 321.3676, GNorm = 4.6763, lr_0 = 9.9948e-04
Validation auc = 0.772115
Epoch 1292
Loss = 8.8630e-02, PNorm = 321.5627, GNorm = 1.7471, lr_0 = 9.9948e-04
Validation auc = 0.742986
Epoch 1293
Loss = 5.6901e-02, PNorm = 321.7862, GNorm = 0.3844, lr_0 = 9.9948e-04
Validation auc = 0.722495
Epoch 1294
Loss = 4.8102e-02, PNorm = 322.0268, GNorm = 3.8647, lr_0 = 9.9948e-04
Validation auc = 0.722798
Epoch 1295
Loss = 4.9467e-02, PNorm = 322.2378, GNorm = 0.9328, lr_0 = 9.9948e-04
Validation auc = 0.721093
Epoch 1296
Loss = 3.2742e-02, PNorm = 322.4212, GNorm = 0.1085, lr_0 = 9.9948e-04
Validation auc = 0.714557
Epoch 1297
Loss = 7.0161e-02, PNorm = 322.5877, GNorm = 1.2287, lr_0 = 9.9948e-04
Validation auc = 0.713963
Epoch 1298
Loss = 1.6881e-02, PNorm = 322.7283, GNorm = 0.9119, lr_0 = 9.9948e-04
Validation auc = 0.735912
Epoch 1299
Loss = 2.7884e-03, PNorm = 322.8568, GNorm = 0.1538, lr_0 = 9.9948e-04
Loss = 3.1976e-02, PNorm = 322.9979, GNorm = 1.4659, lr_0 = 9.9948e-04
Validation auc = 0.737172
Epoch 1300
Loss = 6.2548e-02, PNorm = 323.1601, GNorm = 2.3029, lr_0 = 9.9948e-04
Validation auc = 0.728479
Epoch 1301
Loss = 7.9779e-02, PNorm = 323.3622, GNorm = 0.3829, lr_0 = 9.9947e-04
Validation auc = 0.696035
Epoch 1302
Loss = 4.7530e-02, PNorm = 323.5376, GNorm = 1.3069, lr_0 = 9.9947e-04
Validation auc = 0.707568
Epoch 1303
Loss = 1.2698e-01, PNorm = 323.7162, GNorm = 4.9784, lr_0 = 9.9947e-04
Validation auc = 0.713084
Epoch 1304
Loss = 8.1303e-02, PNorm = 323.8881, GNorm = 2.5680, lr_0 = 9.9947e-04
Validation auc = 0.720861
Epoch 1305
Loss = 2.4347e-02, PNorm = 324.0521, GNorm = 1.2245, lr_0 = 9.9947e-04
Validation auc = 0.717229
Epoch 1306
Loss = 3.0036e-02, PNorm = 324.1783, GNorm = 0.9956, lr_0 = 9.9947e-04
Validation auc = 0.723860
Epoch 1307
Loss = 1.4317e-01, PNorm = 324.3029, GNorm = 0.1636, lr_0 = 9.9947e-04
Validation auc = 0.720358
Epoch 1308
Loss = 1.0969e-01, PNorm = 324.4522, GNorm = 1.8433, lr_0 = 9.9947e-04
Validation auc = 0.714869
Epoch 1309
Loss = 1.1038e-01, PNorm = 324.6192, GNorm = 1.7468, lr_0 = 9.9947e-04
Loss = 3.2755e-02, PNorm = 324.7437, GNorm = 2.0623, lr_0 = 9.9947e-04
Validation auc = 0.722189
Epoch 1310
Loss = 2.1113e-02, PNorm = 324.8576, GNorm = 0.5071, lr_0 = 9.9947e-04
Validation auc = 0.724741
Epoch 1311
Loss = 5.8999e-02, PNorm = 324.9593, GNorm = 4.2984, lr_0 = 9.9947e-04
Validation auc = 0.724509
Epoch 1312
Loss = 4.6168e-02, PNorm = 325.0866, GNorm = 3.7561, lr_0 = 9.9947e-04
Validation auc = 0.723596
Epoch 1313
Loss = 8.2075e-02, PNorm = 325.2625, GNorm = 0.3111, lr_0 = 9.9947e-04
Validation auc = 0.730119
Epoch 1314
Loss = 6.0856e-02, PNorm = 325.4691, GNorm = 2.0291, lr_0 = 9.9947e-04
Validation auc = 0.717666
Epoch 1315
Loss = 6.8748e-02, PNorm = 325.6956, GNorm = 0.1029, lr_0 = 9.9946e-04
Validation auc = 0.705735
Epoch 1316
Loss = 2.5681e-02, PNorm = 325.8917, GNorm = 0.6710, lr_0 = 9.9946e-04
Validation auc = 0.698009
Epoch 1317
Loss = 1.0074e-02, PNorm = 326.0446, GNorm = 0.7729, lr_0 = 9.9946e-04
Validation auc = 0.706029
Epoch 1318
Loss = 4.8293e-03, PNorm = 326.1906, GNorm = 0.2477, lr_0 = 9.9946e-04
Validation auc = 0.714787
Epoch 1319
Loss = 1.0915e-01, PNorm = 326.3342, GNorm = 1.5663, lr_0 = 9.9946e-04
Loss = 2.1312e-02, PNorm = 326.4573, GNorm = 0.7183, lr_0 = 9.9946e-04
Validation auc = 0.721932
Epoch 1320
Loss = 4.0929e-02, PNorm = 326.5682, GNorm = 1.3923, lr_0 = 9.9946e-04
Validation auc = 0.726863
Epoch 1321
Loss = 4.5082e-02, PNorm = 326.6699, GNorm = 0.1956, lr_0 = 9.9946e-04
Validation auc = 0.726369
Epoch 1322
Loss = 3.8546e-02, PNorm = 326.7772, GNorm = 3.8480, lr_0 = 9.9946e-04
Validation auc = 0.734086
Epoch 1323
Loss = 3.3461e-02, PNorm = 326.9224, GNorm = 1.1950, lr_0 = 9.9946e-04
Validation auc = 0.719557
Epoch 1324
Loss = 2.4380e-02, PNorm = 327.0527, GNorm = 0.3806, lr_0 = 9.9946e-04
Validation auc = 0.715983
Epoch 1325
Loss = 4.4522e-02, PNorm = 327.1661, GNorm = 1.7018, lr_0 = 9.9946e-04
Validation auc = 0.723086
Epoch 1326
Loss = 8.0826e-02, PNorm = 327.2833, GNorm = 3.0343, lr_0 = 9.9946e-04
Validation auc = 0.711804
Epoch 1327
Loss = 7.1861e-02, PNorm = 327.4269, GNorm = 2.0908, lr_0 = 9.9946e-04
Validation auc = 0.693804
Epoch 1328
Loss = 2.3895e-02, PNorm = 327.5745, GNorm = 0.2222, lr_0 = 9.9945e-04
Validation auc = 0.701786
Epoch 1329
Loss = 2.7496e-01, PNorm = 327.7373, GNorm = 4.5207, lr_0 = 9.9945e-04
Loss = 6.3645e-02, PNorm = 327.9333, GNorm = 0.5577, lr_0 = 9.9945e-04
Validation auc = 0.701315
Epoch 1330
Loss = 8.1776e-02, PNorm = 328.1180, GNorm = 2.5944, lr_0 = 9.9945e-04
Validation auc = 0.695786
Epoch 1331
Loss = 4.5727e-02, PNorm = 328.2861, GNorm = 0.1658, lr_0 = 9.9945e-04
Validation auc = 0.686460
Epoch 1332
Loss = 5.0681e-02, PNorm = 328.4279, GNorm = 0.9505, lr_0 = 9.9945e-04
Validation auc = 0.685499
Epoch 1333
Loss = 3.3224e-02, PNorm = 328.5536, GNorm = 0.1955, lr_0 = 9.9945e-04
Validation auc = 0.704949
Epoch 1334
Loss = 3.7711e-02, PNorm = 328.6627, GNorm = 0.3296, lr_0 = 9.9945e-04
Validation auc = 0.723214
Epoch 1335
Loss = 4.5081e-02, PNorm = 328.7599, GNorm = 2.1265, lr_0 = 9.9945e-04
Validation auc = 0.726503
Epoch 1336
Loss = 8.8125e-02, PNorm = 328.8494, GNorm = 3.2119, lr_0 = 9.9945e-04
Validation auc = 0.719695
Epoch 1337
Loss = 2.4312e-02, PNorm = 328.9624, GNorm = 1.3520, lr_0 = 9.9945e-04
Validation auc = 0.718614
Epoch 1338
Loss = 7.6784e-02, PNorm = 329.0869, GNorm = 1.8918, lr_0 = 9.9945e-04
Validation auc = 0.726553
Epoch 1339
Loss = 4.1275e-02, PNorm = 329.2389, GNorm = 2.0776, lr_0 = 9.9945e-04
Loss = 4.4106e-02, PNorm = 329.3909, GNorm = 0.2074, lr_0 = 9.9945e-04
Validation auc = 0.736334
Epoch 1340
Loss = 4.4068e-02, PNorm = 329.5336, GNorm = 0.4383, lr_0 = 9.9945e-04
Validation auc = 0.731329
Epoch 1341
Loss = 4.6120e-02, PNorm = 329.6712, GNorm = 0.7106, lr_0 = 9.9944e-04
Validation auc = 0.729278
Epoch 1342
Loss = 2.3008e-02, PNorm = 329.8037, GNorm = 0.9963, lr_0 = 9.9944e-04
Validation auc = 0.720239
Epoch 1343
Loss = 4.2456e-02, PNorm = 329.9360, GNorm = 1.4577, lr_0 = 9.9944e-04
Validation auc = 0.705550
Epoch 1344
Loss = 2.7674e-02, PNorm = 330.0536, GNorm = 0.7930, lr_0 = 9.9944e-04
Validation auc = 0.709677
Epoch 1345
Loss = 2.3651e-01, PNorm = 330.1543, GNorm = 4.0302, lr_0 = 9.9944e-04
Validation auc = 0.721192
Epoch 1346
Loss = 8.1137e-02, PNorm = 330.2928, GNorm = 1.6134, lr_0 = 9.9944e-04
Validation auc = 0.720750
Epoch 1347
Loss = 2.0320e-02, PNorm = 330.4670, GNorm = 0.4076, lr_0 = 9.9944e-04
Validation auc = 0.731913
Epoch 1348
Loss = 3.1972e-02, PNorm = 330.6436, GNorm = 0.8845, lr_0 = 9.9944e-04
Validation auc = 0.735765
Epoch 1349
Loss = 1.3647e-03, PNorm = 330.7618, GNorm = 0.0538, lr_0 = 9.9944e-04
Loss = 1.5128e-02, PNorm = 330.8451, GNorm = 1.0391, lr_0 = 9.9944e-04
Validation auc = 0.741465
Epoch 1350
Loss = 4.9853e-02, PNorm = 330.9478, GNorm = 1.0139, lr_0 = 9.9944e-04
Validation auc = 0.744851
Epoch 1351
Loss = 5.1267e-02, PNorm = 331.0777, GNorm = 1.2280, lr_0 = 9.9944e-04
Validation auc = 0.732360
Epoch 1352
Loss = 5.5235e-02, PNorm = 331.2169, GNorm = 0.1992, lr_0 = 9.9944e-04
Validation auc = 0.704618
Epoch 1353
Loss = 6.6381e-02, PNorm = 331.3742, GNorm = 0.2389, lr_0 = 9.9944e-04
Validation auc = 0.704359
Epoch 1354
Loss = 3.4039e-02, PNorm = 331.5282, GNorm = 2.1185, lr_0 = 9.9943e-04
Validation auc = 0.712431
Epoch 1355
Loss = 5.3991e-02, PNorm = 331.6619, GNorm = 2.4007, lr_0 = 9.9943e-04
Validation auc = 0.703731
Epoch 1356
Loss = 1.3244e-02, PNorm = 331.7877, GNorm = 0.1200, lr_0 = 9.9943e-04
Validation auc = 0.701346
Epoch 1357
Loss = 1.1846e-02, PNorm = 331.9259, GNorm = 1.1915, lr_0 = 9.9943e-04
Validation auc = 0.719568
Epoch 1358
Loss = 1.3044e-01, PNorm = 332.0881, GNorm = 1.1884, lr_0 = 9.9943e-04
Validation auc = 0.710356
Epoch 1359
Loss = 3.8287e-02, PNorm = 332.2443, GNorm = 0.7807, lr_0 = 9.9943e-04
Loss = 8.4995e-02, PNorm = 332.3758, GNorm = 0.9530, lr_0 = 9.9943e-04
Validation auc = 0.705755
Epoch 1360
Loss = 5.3553e-02, PNorm = 332.5134, GNorm = 1.8518, lr_0 = 9.9943e-04
Validation auc = 0.705981
Epoch 1361
Loss = 3.8671e-02, PNorm = 332.6367, GNorm = 0.6426, lr_0 = 9.9943e-04
Validation auc = 0.712998
Epoch 1362
Loss = 3.6283e-02, PNorm = 332.7612, GNorm = 0.4792, lr_0 = 9.9943e-04
Validation auc = 0.724490
Epoch 1363
Loss = 4.4732e-02, PNorm = 332.8928, GNorm = 0.2675, lr_0 = 9.9943e-04
Validation auc = 0.724860
Epoch 1364
Loss = 8.3255e-03, PNorm = 333.0059, GNorm = 0.1410, lr_0 = 9.9943e-04
Validation auc = 0.722163
Epoch 1365
Loss = 9.5379e-02, PNorm = 333.0960, GNorm = 1.4531, lr_0 = 9.9943e-04
Validation auc = 0.704375
Epoch 1366
Loss = 7.9357e-02, PNorm = 333.2337, GNorm = 3.7182, lr_0 = 9.9943e-04
Validation auc = 0.707423
Epoch 1367
Loss = 3.6195e-02, PNorm = 333.4059, GNorm = 0.4316, lr_0 = 9.9943e-04
Validation auc = 0.717439
Epoch 1368
Loss = 3.8021e-02, PNorm = 333.5529, GNorm = 2.9843, lr_0 = 9.9942e-04
Validation auc = 0.708410
Epoch 1369
Loss = 1.2367e-01, PNorm = 333.6709, GNorm = 2.9802, lr_0 = 9.9942e-04
Loss = 3.0387e-02, PNorm = 333.7881, GNorm = 1.3481, lr_0 = 9.9942e-04
Validation auc = 0.724092
Epoch 1370
Loss = 3.4784e-02, PNorm = 333.9062, GNorm = 1.5895, lr_0 = 9.9942e-04
Validation auc = 0.727423
Epoch 1371
Loss = 4.2288e-02, PNorm = 334.0175, GNorm = 2.4131, lr_0 = 9.9942e-04
Validation auc = 0.727084
Epoch 1372
Loss = 5.9585e-02, PNorm = 334.1292, GNorm = 3.0493, lr_0 = 9.9942e-04
Validation auc = 0.728540
Epoch 1373
Loss = 1.9279e-02, PNorm = 334.2414, GNorm = 0.2005, lr_0 = 9.9942e-04
Validation auc = 0.724355
Epoch 1374
Loss = 6.8108e-02, PNorm = 334.3427, GNorm = 3.5146, lr_0 = 9.9942e-04
Validation auc = 0.714369
Epoch 1375
Loss = 8.3950e-02, PNorm = 334.4734, GNorm = 2.2121, lr_0 = 9.9942e-04
Validation auc = 0.719039
Epoch 1376
Loss = 1.0193e-01, PNorm = 334.5906, GNorm = 2.3367, lr_0 = 9.9942e-04
Validation auc = 0.733997
Epoch 1377
Loss = 1.1111e-02, PNorm = 334.7068, GNorm = 0.8578, lr_0 = 9.9942e-04
Validation auc = 0.744330
Epoch 1378
Loss = 3.3598e-02, PNorm = 334.8115, GNorm = 0.4484, lr_0 = 9.9942e-04
Validation auc = 0.738695
Epoch 1379
Loss = 1.1119e-01, PNorm = 334.9225, GNorm = 2.6196, lr_0 = 9.9942e-04
Loss = 3.4564e-02, PNorm = 335.0320, GNorm = 0.6887, lr_0 = 9.9942e-04
Validation auc = 0.735769
Epoch 1380
Loss = 4.7688e-02, PNorm = 335.1541, GNorm = 0.6632, lr_0 = 9.9941e-04
Validation auc = 0.743154
Epoch 1381
Loss = 4.1642e-02, PNorm = 335.3087, GNorm = 2.0428, lr_0 = 9.9941e-04
Validation auc = 0.739478
Epoch 1382
Loss = 4.9474e-02, PNorm = 335.4551, GNorm = 0.1175, lr_0 = 9.9941e-04
Validation auc = 0.736765
Epoch 1383
Loss = 3.1832e-02, PNorm = 335.5647, GNorm = 0.1991, lr_0 = 9.9941e-04
Validation auc = 0.739568
Epoch 1384
Loss = 1.2392e-02, PNorm = 335.6636, GNorm = 0.8251, lr_0 = 9.9941e-04
Validation auc = 0.712991
Epoch 1385
Loss = 2.6272e-02, PNorm = 335.7544, GNorm = 0.5203, lr_0 = 9.9941e-04
Validation auc = 0.716915
Epoch 1386
Loss = 2.6653e-02, PNorm = 335.8379, GNorm = 0.2701, lr_0 = 9.9941e-04
Validation auc = 0.720995
Epoch 1387
Loss = 3.3022e-02, PNorm = 335.9125, GNorm = 0.0610, lr_0 = 9.9941e-04
Validation auc = 0.722203
Epoch 1388
Loss = 1.0959e-03, PNorm = 335.9859, GNorm = 0.0043, lr_0 = 9.9941e-04
Validation auc = 0.716908
Epoch 1389
Loss = 3.4292e-04, PNorm = 336.0493, GNorm = 0.0171, lr_0 = 9.9941e-04
Loss = 1.9000e-02, PNorm = 336.1217, GNorm = 0.3668, lr_0 = 9.9941e-04
Validation auc = 0.721061
Epoch 1390
Loss = 3.9594e-02, PNorm = 336.1888, GNorm = 0.8127, lr_0 = 9.9941e-04
Validation auc = 0.724088
Epoch 1391
Loss = 2.5243e-02, PNorm = 336.2603, GNorm = 2.0533, lr_0 = 9.9941e-04
Validation auc = 0.727958
Epoch 1392
Loss = 1.7323e-01, PNorm = 336.4092, GNorm = 5.4337, lr_0 = 9.9941e-04
Validation auc = 0.727749
Epoch 1393
Loss = 4.1982e-02, PNorm = 336.5997, GNorm = 0.5463, lr_0 = 9.9941e-04
Validation auc = 0.713285
Epoch 1394
Loss = 1.8081e-02, PNorm = 336.7792, GNorm = 0.9680, lr_0 = 9.9940e-04
Validation auc = 0.696174
Epoch 1395
Loss = 4.8276e-02, PNorm = 336.9300, GNorm = 1.6834, lr_0 = 9.9940e-04
Validation auc = 0.692767
Epoch 1396
Loss = 1.3237e-01, PNorm = 337.0862, GNorm = 2.1004, lr_0 = 9.9940e-04
Validation auc = 0.709745
Epoch 1397
Loss = 1.1443e-01, PNorm = 337.2719, GNorm = 0.5652, lr_0 = 9.9940e-04
Validation auc = 0.698196
Epoch 1398
Loss = 2.4875e-02, PNorm = 337.4865, GNorm = 0.7138, lr_0 = 9.9940e-04
Validation auc = 0.720049
Epoch 1399
Loss = 6.9797e-03, PNorm = 337.6740, GNorm = 0.3359, lr_0 = 9.9940e-04
Loss = 8.1712e-02, PNorm = 337.8301, GNorm = 1.6668, lr_0 = 9.9940e-04
Validation auc = 0.718539
Epoch 1400
Loss = 3.9745e-02, PNorm = 337.9858, GNorm = 2.1281, lr_0 = 9.9940e-04
Validation auc = 0.702939
Epoch 1401
Loss = 3.2621e-02, PNorm = 338.1250, GNorm = 0.2328, lr_0 = 9.9940e-04
Validation auc = 0.711899
Epoch 1402
Loss = 2.8251e-02, PNorm = 338.2452, GNorm = 1.4833, lr_0 = 9.9940e-04
Validation auc = 0.725138
Epoch 1403
Loss = 5.6203e-02, PNorm = 338.3632, GNorm = 3.7924, lr_0 = 9.9940e-04
Validation auc = 0.714492
Epoch 1404
Loss = 4.1285e-02, PNorm = 338.5063, GNorm = 0.6868, lr_0 = 9.9940e-04
Validation auc = 0.696894
Epoch 1405
Loss = 6.1217e-02, PNorm = 338.6679, GNorm = 0.9904, lr_0 = 9.9940e-04
Validation auc = 0.712601
Epoch 1406
Loss = 3.2770e-02, PNorm = 338.8111, GNorm = 1.0588, lr_0 = 9.9940e-04
Validation auc = 0.715498
Epoch 1407
Loss = 1.4744e-02, PNorm = 338.9195, GNorm = 0.5187, lr_0 = 9.9939e-04
Validation auc = 0.702126
Epoch 1408
Loss = 1.8796e-02, PNorm = 339.0615, GNorm = 1.0435, lr_0 = 9.9939e-04
Validation auc = 0.712952
Epoch 1409
Loss = 2.3198e-02, PNorm = 339.1816, GNorm = 0.6605, lr_0 = 9.9939e-04
Loss = 1.2010e-01, PNorm = 339.2795, GNorm = 5.1471, lr_0 = 9.9939e-04
Validation auc = 0.689892
Epoch 1410
Loss = 4.7098e-02, PNorm = 339.4436, GNorm = 1.1760, lr_0 = 9.9939e-04
Validation auc = 0.678045
Epoch 1411
Loss = 8.6606e-02, PNorm = 339.5912, GNorm = 3.8892, lr_0 = 9.9939e-04
Validation auc = 0.681149
Epoch 1412
Loss = 4.6810e-02, PNorm = 339.7544, GNorm = 0.4508, lr_0 = 9.9939e-04
Validation auc = 0.685569
Epoch 1413
Loss = 4.1631e-02, PNorm = 339.8822, GNorm = 1.8293, lr_0 = 9.9939e-04
Validation auc = 0.686211
Epoch 1414
Loss = 1.1617e-01, PNorm = 339.9881, GNorm = 1.6370, lr_0 = 9.9939e-04
Validation auc = 0.697098
Epoch 1415
Loss = 2.8698e-02, PNorm = 340.1300, GNorm = 1.8022, lr_0 = 9.9939e-04
Validation auc = 0.711254
Epoch 1416
Loss = 1.9417e-01, PNorm = 340.2648, GNorm = 1.6257, lr_0 = 9.9939e-04
Validation auc = 0.690119
Epoch 1417
Loss = 1.7518e-01, PNorm = 340.4358, GNorm = 4.3055, lr_0 = 9.9939e-04
Validation auc = 0.703172
Epoch 1418
Loss = 2.3701e-02, PNorm = 340.6208, GNorm = 0.7380, lr_0 = 9.9939e-04
Validation auc = 0.698793
Epoch 1419
Loss = 2.4239e-01, PNorm = 340.7933, GNorm = 2.5571, lr_0 = 9.9939e-04
Loss = 4.0984e-02, PNorm = 340.9689, GNorm = 1.1794, lr_0 = 9.9939e-04
Validation auc = 0.687174
Epoch 1420
Loss = 2.5507e-02, PNorm = 341.1075, GNorm = 1.2484, lr_0 = 9.9938e-04
Validation auc = 0.694099
Epoch 1421
Loss = 1.2919e-02, PNorm = 341.2150, GNorm = 0.1421, lr_0 = 9.9938e-04
Validation auc = 0.708415
Epoch 1422
Loss = 6.5027e-02, PNorm = 341.2945, GNorm = 0.1696, lr_0 = 9.9938e-04
Validation auc = 0.717537
Epoch 1423
Loss = 4.9476e-02, PNorm = 341.3997, GNorm = 0.3704, lr_0 = 9.9938e-04
Validation auc = 0.722136
Epoch 1424
Loss = 6.8160e-02, PNorm = 341.5228, GNorm = 1.9848, lr_0 = 9.9938e-04
Validation auc = 0.721761
Epoch 1425
Loss = 7.1784e-02, PNorm = 341.6503, GNorm = 1.3441, lr_0 = 9.9938e-04
Validation auc = 0.716182
Epoch 1426
Loss = 1.6762e-02, PNorm = 341.7811, GNorm = 0.3575, lr_0 = 9.9938e-04
Validation auc = 0.707900
Epoch 1427
Loss = 6.5718e-02, PNorm = 341.9099, GNorm = 0.0437, lr_0 = 9.9938e-04
Validation auc = 0.720107
Epoch 1428
Loss = 1.4479e-01, PNorm = 342.0531, GNorm = 9.1381, lr_0 = 9.9938e-04
Validation auc = 0.718248
Epoch 1429
Loss = 2.0989e-02, PNorm = 342.2249, GNorm = 0.9985, lr_0 = 9.9938e-04
Loss = 6.6247e-02, PNorm = 342.3850, GNorm = 3.9270, lr_0 = 9.9938e-04
Validation auc = 0.729732
Epoch 1430
Loss = 1.1405e-01, PNorm = 342.6163, GNorm = 1.6203, lr_0 = 9.9938e-04
Validation auc = 0.698800
Epoch 1431
Loss = 1.2956e-01, PNorm = 342.9280, GNorm = 3.3298, lr_0 = 9.9938e-04
Validation auc = 0.699954
Epoch 1432
Loss = 7.5253e-02, PNorm = 343.2311, GNorm = 1.6399, lr_0 = 9.9938e-04
Validation auc = 0.717454
Epoch 1433
Loss = 7.7148e-02, PNorm = 343.4555, GNorm = 2.4037, lr_0 = 9.9937e-04
Validation auc = 0.710241
Epoch 1434
Loss = 2.5860e-02, PNorm = 343.6340, GNorm = 0.3879, lr_0 = 9.9937e-04
Validation auc = 0.716793
Epoch 1435
Loss = 2.6468e-02, PNorm = 343.7995, GNorm = 1.8715, lr_0 = 9.9937e-04
Validation auc = 0.706025
Epoch 1436
Loss = 4.9463e-02, PNorm = 343.9538, GNorm = 2.1128, lr_0 = 9.9937e-04
Validation auc = 0.694840
Epoch 1437
Loss = 6.9458e-02, PNorm = 344.1226, GNorm = 1.7917, lr_0 = 9.9937e-04
Validation auc = 0.710310
Epoch 1438
Loss = 8.9902e-02, PNorm = 344.2809, GNorm = 3.2423, lr_0 = 9.9937e-04
Validation auc = 0.708280
Epoch 1439
Loss = 3.0703e-02, PNorm = 344.4492, GNorm = 1.1135, lr_0 = 9.9937e-04
Loss = 5.0100e-02, PNorm = 344.5937, GNorm = 0.1666, lr_0 = 9.9937e-04
Validation auc = 0.693452
Epoch 1440
Loss = 3.1544e-02, PNorm = 344.7082, GNorm = 0.2613, lr_0 = 9.9937e-04
Validation auc = 0.680326
Epoch 1441
Loss = 4.7122e-02, PNorm = 344.8071, GNorm = 0.1576, lr_0 = 9.9937e-04
Validation auc = 0.677908
Epoch 1442
Loss = 3.4660e-02, PNorm = 344.8995, GNorm = 1.7233, lr_0 = 9.9937e-04
Validation auc = 0.688661
Epoch 1443
Loss = 5.9618e-02, PNorm = 345.0136, GNorm = 0.9482, lr_0 = 9.9937e-04
Validation auc = 0.704575
Epoch 1444
Loss = 1.0912e-01, PNorm = 345.1406, GNorm = 3.1283, lr_0 = 9.9937e-04
Validation auc = 0.703153
Epoch 1445
Loss = 3.5213e-02, PNorm = 345.2637, GNorm = 1.3809, lr_0 = 9.9937e-04
Validation auc = 0.701125
Epoch 1446
Loss = 2.9115e-02, PNorm = 345.3856, GNorm = 1.7379, lr_0 = 9.9937e-04
Validation auc = 0.693250
Epoch 1447
Loss = 3.9500e-03, PNorm = 345.5001, GNorm = 0.0521, lr_0 = 9.9936e-04
Validation auc = 0.705058
Epoch 1448
Loss = 7.4149e-02, PNorm = 345.5963, GNorm = 0.2296, lr_0 = 9.9936e-04
Validation auc = 0.710870
Epoch 1449
Loss = 1.6491e-02, PNorm = 345.7106, GNorm = 1.0857, lr_0 = 9.9936e-04
Loss = 5.5128e-02, PNorm = 345.8444, GNorm = 0.0318, lr_0 = 9.9936e-04
Validation auc = 0.716747
Epoch 1450
Loss = 6.4687e-02, PNorm = 346.0287, GNorm = 4.5482, lr_0 = 9.9936e-04
Validation auc = 0.722731
Epoch 1451
Loss = 5.2220e-02, PNorm = 346.2173, GNorm = 4.1836, lr_0 = 9.9936e-04
Validation auc = 0.716214
Epoch 1452
Loss = 3.0455e-02, PNorm = 346.3779, GNorm = 0.2970, lr_0 = 9.9936e-04
Validation auc = 0.722178
Epoch 1453
Loss = 9.3648e-02, PNorm = 346.5336, GNorm = 2.1856, lr_0 = 9.9936e-04
Validation auc = 0.732683
Epoch 1454
Loss = 4.8899e-02, PNorm = 346.6809, GNorm = 0.7353, lr_0 = 9.9936e-04
Validation auc = 0.729326
Epoch 1455
Loss = 9.9084e-02, PNorm = 346.7960, GNorm = 1.8681, lr_0 = 9.9936e-04
Validation auc = 0.725800
Epoch 1456
Loss = 1.2481e-01, PNorm = 346.8989, GNorm = 2.7951, lr_0 = 9.9936e-04
Validation auc = 0.732712
Epoch 1457
Loss = 1.6793e-02, PNorm = 347.0159, GNorm = 0.3358, lr_0 = 9.9936e-04
Validation auc = 0.727976
Epoch 1458
Loss = 1.6118e-02, PNorm = 347.1212, GNorm = 1.5016, lr_0 = 9.9936e-04
Validation auc = 0.716352
Epoch 1459
Loss = 8.1321e-02, PNorm = 347.2219, GNorm = 1.8357, lr_0 = 9.9936e-04
Loss = 5.9325e-02, PNorm = 347.3276, GNorm = 1.1956, lr_0 = 9.9936e-04
Validation auc = 0.705162
Epoch 1460
Loss = 5.7771e-02, PNorm = 347.4488, GNorm = 0.8157, lr_0 = 9.9935e-04
Validation auc = 0.702416
Epoch 1461
Loss = 5.3502e-02, PNorm = 347.5960, GNorm = 0.1576, lr_0 = 9.9935e-04
Validation auc = 0.712910
Epoch 1462
Loss = 4.0379e-02, PNorm = 347.7374, GNorm = 1.9278, lr_0 = 9.9935e-04
Validation auc = 0.733510
Epoch 1463
Loss = 5.5696e-02, PNorm = 347.8664, GNorm = 0.5534, lr_0 = 9.9935e-04
Validation auc = 0.714472
Epoch 1464
Loss = 7.2862e-02, PNorm = 347.9835, GNorm = 2.5768, lr_0 = 9.9935e-04
Validation auc = 0.715541
Epoch 1465
Loss = 5.7399e-02, PNorm = 348.1190, GNorm = 0.8715, lr_0 = 9.9935e-04
Validation auc = 0.710196
Epoch 1466
Loss = 8.0131e-02, PNorm = 348.2485, GNorm = 1.3276, lr_0 = 9.9935e-04
Validation auc = 0.707756
Epoch 1467
Loss = 5.6631e-02, PNorm = 348.3528, GNorm = 2.3962, lr_0 = 9.9935e-04
Validation auc = 0.722015
Epoch 1468
Loss = 2.1884e-02, PNorm = 348.4519, GNorm = 0.1826, lr_0 = 9.9935e-04
Validation auc = 0.732412
Epoch 1469
Loss = 1.5544e-02, PNorm = 348.5440, GNorm = 0.7886, lr_0 = 9.9935e-04
Loss = 3.3680e-02, PNorm = 348.6429, GNorm = 0.1361, lr_0 = 9.9935e-04
Validation auc = 0.728141
Epoch 1470
Loss = 8.1005e-02, PNorm = 348.7545, GNorm = 0.1717, lr_0 = 9.9935e-04
Validation auc = 0.715577
Epoch 1471
Loss = 5.0584e-02, PNorm = 348.8831, GNorm = 0.8910, lr_0 = 9.9935e-04
Validation auc = 0.706469
Epoch 1472
Loss = 3.4825e-02, PNorm = 349.0326, GNorm = 0.8749, lr_0 = 9.9935e-04
Validation auc = 0.719768
Epoch 1473
Loss = 6.2866e-02, PNorm = 349.1796, GNorm = 1.5196, lr_0 = 9.9934e-04
Validation auc = 0.728731
Epoch 1474
Loss = 2.4992e-02, PNorm = 349.3329, GNorm = 0.1969, lr_0 = 9.9934e-04
Validation auc = 0.709437
Epoch 1475
Loss = 3.4053e-02, PNorm = 349.4698, GNorm = 0.7838, lr_0 = 9.9934e-04
Validation auc = 0.717392
Epoch 1476
Loss = 9.7965e-03, PNorm = 349.6021, GNorm = 0.8643, lr_0 = 9.9934e-04
Validation auc = 0.732894
Epoch 1477
Loss = 5.4625e-02, PNorm = 349.7364, GNorm = 0.5303, lr_0 = 9.9934e-04
Validation auc = 0.718597
Epoch 1478
Loss = 9.3890e-03, PNorm = 349.8860, GNorm = 0.2026, lr_0 = 9.9934e-04
Validation auc = 0.716065
Epoch 1479
Loss = 1.8350e-01, PNorm = 350.1170, GNorm = 5.9921, lr_0 = 9.9934e-04
Loss = 8.6793e-02, PNorm = 350.4042, GNorm = 1.4161, lr_0 = 9.9934e-04
Validation auc = 0.735918
Epoch 1480
Loss = 2.8136e-02, PNorm = 350.6185, GNorm = 2.3937, lr_0 = 9.9934e-04
Validation auc = 0.743821
Epoch 1481
Loss = 8.4040e-02, PNorm = 350.7646, GNorm = 3.8329, lr_0 = 9.9934e-04
Validation auc = 0.736759
Epoch 1482
Loss = 9.0232e-02, PNorm = 350.8994, GNorm = 4.8707, lr_0 = 9.9934e-04
Validation auc = 0.735614
Epoch 1483
Loss = 4.0101e-02, PNorm = 351.0420, GNorm = 0.8926, lr_0 = 9.9934e-04
Validation auc = 0.728947
Epoch 1484
Loss = 3.0821e-02, PNorm = 351.1726, GNorm = 4.9079, lr_0 = 9.9934e-04
Validation auc = 0.728219
Epoch 1485
Loss = 3.6239e-02, PNorm = 351.3283, GNorm = 2.4129, lr_0 = 9.9934e-04
Validation auc = 0.723075
Epoch 1486
Loss = 1.0094e-01, PNorm = 351.5128, GNorm = 4.2870, lr_0 = 9.9934e-04
Validation auc = 0.725039
Epoch 1487
Loss = 3.7615e-02, PNorm = 351.7231, GNorm = 0.3388, lr_0 = 9.9933e-04
Validation auc = 0.728923
Epoch 1488
Loss = 4.8320e-02, PNorm = 351.8808, GNorm = 0.9577, lr_0 = 9.9933e-04
Validation auc = 0.726398
Epoch 1489
Loss = 2.4796e-02, PNorm = 352.0318, GNorm = 1.5480, lr_0 = 9.9933e-04
Loss = 5.7040e-02, PNorm = 352.1846, GNorm = 0.8453, lr_0 = 9.9933e-04
Validation auc = 0.728250
Epoch 1490
Loss = 7.7742e-02, PNorm = 352.3448, GNorm = 1.1128, lr_0 = 9.9933e-04
Validation auc = 0.725965
Epoch 1491
Loss = 8.7081e-02, PNorm = 352.5038, GNorm = 1.4666, lr_0 = 9.9933e-04
Validation auc = 0.729686
Epoch 1492
Loss = 7.0149e-02, PNorm = 352.6595, GNorm = 3.8546, lr_0 = 9.9933e-04
Validation auc = 0.733622
Epoch 1493
Loss = 3.7615e-02, PNorm = 352.7955, GNorm = 1.7703, lr_0 = 9.9933e-04
Validation auc = 0.735597
Epoch 1494
Loss = 1.7835e-02, PNorm = 352.8935, GNorm = 0.1980, lr_0 = 9.9933e-04
Validation auc = 0.722723
Epoch 1495
Loss = 2.5411e-02, PNorm = 352.9970, GNorm = 2.6645, lr_0 = 9.9933e-04
Validation auc = 0.725421
Epoch 1496
Loss = 7.7193e-02, PNorm = 353.1112, GNorm = 0.8584, lr_0 = 9.9933e-04
Validation auc = 0.732855
Epoch 1497
Loss = 1.1152e-02, PNorm = 353.2580, GNorm = 0.4217, lr_0 = 9.9933e-04
Validation auc = 0.736955
Epoch 1498
Loss = 7.1911e-02, PNorm = 353.4081, GNorm = 1.8611, lr_0 = 9.9933e-04
Validation auc = 0.732857
Epoch 1499
Loss = 1.0845e-01, PNorm = 353.5343, GNorm = 1.6172, lr_0 = 9.9933e-04
Loss = 5.2763e-02, PNorm = 353.6478, GNorm = 0.2018, lr_0 = 9.9932e-04
Validation auc = 0.724207
Epoch 1500
Loss = 5.8858e-02, PNorm = 353.7436, GNorm = 2.1904, lr_0 = 9.9932e-04
Validation auc = 0.719625
Epoch 1501
Loss = 2.8715e-02, PNorm = 353.8501, GNorm = 0.5704, lr_0 = 9.9932e-04
Validation auc = 0.713893
Epoch 1502
Loss = 6.2273e-02, PNorm = 353.9570, GNorm = 0.5679, lr_0 = 9.9932e-04
Validation auc = 0.732798
Epoch 1503
Loss = 3.9855e-02, PNorm = 354.0871, GNorm = 0.4753, lr_0 = 9.9932e-04
Validation auc = 0.743757
Epoch 1504
Loss = 3.6596e-02, PNorm = 354.1974, GNorm = 1.6593, lr_0 = 9.9932e-04
Validation auc = 0.752830
Epoch 1505
Loss = 5.3858e-02, PNorm = 354.2921, GNorm = 0.6889, lr_0 = 9.9932e-04
Validation auc = 0.753668
Epoch 1506
Loss = 1.2596e-02, PNorm = 354.3751, GNorm = 1.5274, lr_0 = 9.9932e-04
Validation auc = 0.748171
Epoch 1507
Loss = 6.9176e-03, PNorm = 354.4424, GNorm = 1.2241, lr_0 = 9.9932e-04
Validation auc = 0.744180
Epoch 1508
Loss = 1.1600e-02, PNorm = 354.5256, GNorm = 0.5520, lr_0 = 9.9932e-04
Validation auc = 0.739823
Epoch 1509
Loss = 1.0668e-02, PNorm = 354.6140, GNorm = 0.4259, lr_0 = 9.9932e-04
Loss = 1.4945e-02, PNorm = 354.6807, GNorm = 0.8621, lr_0 = 9.9932e-04
Validation auc = 0.737953
Epoch 1510
Loss = 3.9964e-02, PNorm = 354.7385, GNorm = 0.1415, lr_0 = 9.9932e-04
Validation auc = 0.733419
Epoch 1511
Loss = 1.7964e-02, PNorm = 354.7960, GNorm = 0.0497, lr_0 = 9.9932e-04
Validation auc = 0.723711
Epoch 1512
Loss = 9.9588e-03, PNorm = 354.8598, GNorm = 0.0526, lr_0 = 9.9932e-04
Validation auc = 0.729308
Epoch 1513
Loss = 4.7821e-02, PNorm = 354.9257, GNorm = 1.5098, lr_0 = 9.9931e-04
Validation auc = 0.733081
Epoch 1514
Loss = 2.5146e-02, PNorm = 355.0170, GNorm = 2.9758, lr_0 = 9.9931e-04
Validation auc = 0.722512
Epoch 1515
Loss = 4.5451e-02, PNorm = 355.1337, GNorm = 0.4262, lr_0 = 9.9931e-04
Validation auc = 0.729813
Epoch 1516
Loss = 2.8678e-02, PNorm = 355.2490, GNorm = 0.1221, lr_0 = 9.9931e-04
Validation auc = 0.735243
Epoch 1517
Loss = 3.1421e-02, PNorm = 355.3735, GNorm = 1.4366, lr_0 = 9.9931e-04
Validation auc = 0.730638
Epoch 1518
Loss = 6.4308e-02, PNorm = 355.5596, GNorm = 1.4054, lr_0 = 9.9931e-04
Validation auc = 0.751944
Epoch 1519
Loss = 3.4442e-02, PNorm = 355.8197, GNorm = 0.7856, lr_0 = 9.9931e-04
Loss = 5.6203e-02, PNorm = 356.0470, GNorm = 0.7087, lr_0 = 9.9931e-04
Validation auc = 0.759821
Epoch 1520
Loss = 4.6895e-02, PNorm = 356.2239, GNorm = 1.1055, lr_0 = 9.9931e-04
Validation auc = 0.760953
Epoch 1521
Loss = 9.1566e-02, PNorm = 356.3714, GNorm = 1.0830, lr_0 = 9.9931e-04
Validation auc = 0.716208
Epoch 1522
Loss = 3.6240e-02, PNorm = 356.5187, GNorm = 0.4701, lr_0 = 9.9931e-04
Validation auc = 0.713749
Epoch 1523
Loss = 5.2596e-02, PNorm = 356.6703, GNorm = 1.8918, lr_0 = 9.9931e-04
Validation auc = 0.721463
Epoch 1524
Loss = 3.7308e-02, PNorm = 356.8192, GNorm = 0.5392, lr_0 = 9.9931e-04
Validation auc = 0.712544
Epoch 1525
Loss = 4.9898e-02, PNorm = 356.9679, GNorm = 0.0962, lr_0 = 9.9931e-04
Validation auc = 0.707558
Epoch 1526
Loss = 4.5782e-02, PNorm = 357.1208, GNorm = 4.4655, lr_0 = 9.9930e-04
Validation auc = 0.725085
Epoch 1527
Loss = 1.0349e-01, PNorm = 357.2836, GNorm = 1.9711, lr_0 = 9.9930e-04
Validation auc = 0.721593
Epoch 1528
Loss = 2.0770e-02, PNorm = 357.4497, GNorm = 0.3935, lr_0 = 9.9930e-04
Validation auc = 0.721686
Epoch 1529
Loss = 3.3552e-03, PNorm = 357.5952, GNorm = 0.1437, lr_0 = 9.9930e-04
Loss = 3.7783e-02, PNorm = 357.7373, GNorm = 0.3609, lr_0 = 9.9930e-04
Validation auc = 0.701016
Epoch 1530
Loss = 2.6870e-02, PNorm = 357.8564, GNorm = 1.8545, lr_0 = 9.9930e-04
Validation auc = 0.683718
Epoch 1531
Loss = 4.4117e-02, PNorm = 357.9500, GNorm = 0.3406, lr_0 = 9.9930e-04
Validation auc = 0.688850
Epoch 1532
Loss = 2.2162e-02, PNorm = 358.0755, GNorm = 0.7039, lr_0 = 9.9930e-04
Validation auc = 0.703388
Epoch 1533
Loss = 2.2568e-02, PNorm = 358.1997, GNorm = 0.6098, lr_0 = 9.9930e-04
Validation auc = 0.708446
Epoch 1534
Loss = 9.7208e-02, PNorm = 358.3262, GNorm = 0.4853, lr_0 = 9.9930e-04
Validation auc = 0.712803
Epoch 1535
Loss = 1.1208e-01, PNorm = 358.4835, GNorm = 3.6611, lr_0 = 9.9930e-04
Validation auc = 0.713801
Epoch 1536
Loss = 7.8454e-02, PNorm = 358.6330, GNorm = 1.9847, lr_0 = 9.9930e-04
Validation auc = 0.720459
Epoch 1537
Loss = 5.1751e-02, PNorm = 358.7728, GNorm = 0.3223, lr_0 = 9.9930e-04
Validation auc = 0.715078
Epoch 1538
Loss = 7.0573e-02, PNorm = 358.9096, GNorm = 1.4520, lr_0 = 9.9930e-04
Validation auc = 0.702504
Epoch 1539
Loss = 1.6726e-02, PNorm = 359.0424, GNorm = 0.6316, lr_0 = 9.9930e-04
Loss = 6.9264e-02, PNorm = 359.1492, GNorm = 2.6448, lr_0 = 9.9929e-04
Validation auc = 0.711227
Epoch 1540
Loss = 1.6599e-02, PNorm = 359.2431, GNorm = 1.1790, lr_0 = 9.9929e-04
Validation auc = 0.709386
Epoch 1541
Loss = 8.5184e-02, PNorm = 359.3335, GNorm = 0.5256, lr_0 = 9.9929e-04
Validation auc = 0.707514
Epoch 1542
Loss = 1.1487e-01, PNorm = 359.4464, GNorm = 3.4171, lr_0 = 9.9929e-04
Validation auc = 0.698837
Epoch 1543
Loss = 3.9310e-02, PNorm = 359.5845, GNorm = 0.8975, lr_0 = 9.9929e-04
Validation auc = 0.713204
Epoch 1544
Loss = 1.1391e-01, PNorm = 359.7060, GNorm = 1.4293, lr_0 = 9.9929e-04
Validation auc = 0.700277
Epoch 1545
Loss = 3.1609e-02, PNorm = 359.8338, GNorm = 0.4237, lr_0 = 9.9929e-04
Validation auc = 0.701886
Epoch 1546
Loss = 3.0847e-02, PNorm = 359.9351, GNorm = 1.8244, lr_0 = 9.9929e-04
Validation auc = 0.710669
Epoch 1547
Loss = 4.9531e-02, PNorm = 360.0337, GNorm = 1.1239, lr_0 = 9.9929e-04
Validation auc = 0.727487
Epoch 1548
Loss = 7.5981e-02, PNorm = 360.1461, GNorm = 0.7544, lr_0 = 9.9929e-04
Validation auc = 0.723235
Epoch 1549
Loss = 2.6492e-02, PNorm = 360.2493, GNorm = 0.6728, lr_0 = 9.9929e-04
Loss = 2.6401e-02, PNorm = 360.3482, GNorm = 1.0811, lr_0 = 9.9929e-04
Validation auc = 0.728447
Epoch 1550
Loss = 6.1872e-02, PNorm = 360.4203, GNorm = 2.2979, lr_0 = 9.9929e-04
Validation auc = 0.721081
Epoch 1551
Loss = 2.4714e-02, PNorm = 360.5339, GNorm = 0.0907, lr_0 = 9.9929e-04
Validation auc = 0.725283
Epoch 1552
Loss = 5.1462e-02, PNorm = 360.6590, GNorm = 1.0041, lr_0 = 9.9928e-04
Validation auc = 0.719875
Epoch 1553
Loss = 3.8561e-02, PNorm = 360.8067, GNorm = 3.3586, lr_0 = 9.9928e-04
Validation auc = 0.709112
Epoch 1554
Loss = 4.6962e-02, PNorm = 360.9245, GNorm = 2.7399, lr_0 = 9.9928e-04
Validation auc = 0.718187
Epoch 1555
Loss = 2.0995e-02, PNorm = 361.0289, GNorm = 0.0715, lr_0 = 9.9928e-04
Validation auc = 0.731179
Epoch 1556
Loss = 5.0111e-02, PNorm = 361.1244, GNorm = 2.6617, lr_0 = 9.9928e-04
Validation auc = 0.744204
Epoch 1557
Loss = 8.0953e-02, PNorm = 361.2719, GNorm = 3.3378, lr_0 = 9.9928e-04
Validation auc = 0.741381
Epoch 1558
Loss = 8.9166e-02, PNorm = 361.4375, GNorm = 1.8929, lr_0 = 9.9928e-04
Validation auc = 0.723772
Epoch 1559
Loss = 1.2683e-03, PNorm = 361.6163, GNorm = 0.0798, lr_0 = 9.9928e-04
Loss = 4.4768e-02, PNorm = 361.7581, GNorm = 2.0698, lr_0 = 9.9928e-04
Validation auc = 0.712959
Epoch 1560
Loss = 7.3072e-02, PNorm = 361.8768, GNorm = 1.1819, lr_0 = 9.9928e-04
Validation auc = 0.704093
Epoch 1561
Loss = 4.1504e-02, PNorm = 362.0058, GNorm = 0.2787, lr_0 = 9.9928e-04
Validation auc = 0.695917
Epoch 1562
Loss = 2.7617e-02, PNorm = 362.1094, GNorm = 0.6000, lr_0 = 9.9928e-04
Validation auc = 0.699866
Epoch 1563
Loss = 3.2842e-02, PNorm = 362.1957, GNorm = 0.1494, lr_0 = 9.9928e-04
Validation auc = 0.706932
Epoch 1564
Loss = 5.5043e-02, PNorm = 362.2966, GNorm = 0.5361, lr_0 = 9.9928e-04
Validation auc = 0.715353
Epoch 1565
Loss = 4.8689e-02, PNorm = 362.4143, GNorm = 1.0244, lr_0 = 9.9928e-04
Validation auc = 0.714981
Epoch 1566
Loss = 6.1992e-02, PNorm = 362.5385, GNorm = 0.2312, lr_0 = 9.9927e-04
Validation auc = 0.688164
Epoch 1567
Loss = 6.7627e-03, PNorm = 362.6848, GNorm = 0.4161, lr_0 = 9.9927e-04
Validation auc = 0.691222
Epoch 1568
Loss = 2.1363e-02, PNorm = 362.8069, GNorm = 0.9386, lr_0 = 9.9927e-04
Validation auc = 0.710321
Epoch 1569
Loss = 2.6885e-03, PNorm = 362.9212, GNorm = 0.0948, lr_0 = 9.9927e-04
Loss = 7.5366e-02, PNorm = 363.0373, GNorm = 0.1977, lr_0 = 9.9927e-04
Validation auc = 0.727216
Epoch 1570
Loss = 3.3846e-02, PNorm = 363.1461, GNorm = 6.5986, lr_0 = 9.9927e-04
Validation auc = 0.729288
Epoch 1571
Loss = 3.1093e-02, PNorm = 363.2458, GNorm = 0.7351, lr_0 = 9.9927e-04
Validation auc = 0.712484
Epoch 1572
Loss = 3.9391e-02, PNorm = 363.3298, GNorm = 3.6250, lr_0 = 9.9927e-04
Validation auc = 0.711071
Epoch 1573
Loss = 1.7539e-02, PNorm = 363.4148, GNorm = 0.0372, lr_0 = 9.9927e-04
Validation auc = 0.709106
Epoch 1574
Loss = 2.8356e-02, PNorm = 363.4898, GNorm = 0.2730, lr_0 = 9.9927e-04
Validation auc = 0.712751
Epoch 1575
Loss = 2.0974e-02, PNorm = 363.5613, GNorm = 0.3471, lr_0 = 9.9927e-04
Validation auc = 0.714814
Epoch 1576
Loss = 4.0633e-03, PNorm = 363.6207, GNorm = 0.0767, lr_0 = 9.9927e-04
Validation auc = 0.718838
Epoch 1577
Loss = 1.0391e-02, PNorm = 363.6670, GNorm = 0.1395, lr_0 = 9.9927e-04
Validation auc = 0.718125
Epoch 1578
Loss = 1.1348e-01, PNorm = 363.7398, GNorm = 6.6027, lr_0 = 9.9927e-04
Validation auc = 0.713906
Epoch 1579
Loss = 6.5858e-02, PNorm = 363.8888, GNorm = 2.5813, lr_0 = 9.9926e-04
Loss = 4.2911e-02, PNorm = 364.0265, GNorm = 1.3546, lr_0 = 9.9926e-04
Validation auc = 0.717600
Epoch 1580
Loss = 1.1806e-01, PNorm = 364.1543, GNorm = 1.7834, lr_0 = 9.9926e-04
Validation auc = 0.724361
Epoch 1581
Loss = 6.9976e-02, PNorm = 364.3017, GNorm = 0.3738, lr_0 = 9.9926e-04
Validation auc = 0.716755
Epoch 1582
Loss = 2.6916e-02, PNorm = 364.4339, GNorm = 0.4188, lr_0 = 9.9926e-04
Validation auc = 0.723353
Epoch 1583
Loss = 4.2182e-02, PNorm = 364.5360, GNorm = 1.8306, lr_0 = 9.9926e-04
Validation auc = 0.710310
Epoch 1584
Loss = 1.1269e-02, PNorm = 364.6512, GNorm = 0.2708, lr_0 = 9.9926e-04
Validation auc = 0.720340
Epoch 1585
Loss = 1.8711e-02, PNorm = 364.7501, GNorm = 0.8318, lr_0 = 9.9926e-04
Validation auc = 0.731572
Epoch 1586
Loss = 3.5982e-02, PNorm = 364.8393, GNorm = 1.9200, lr_0 = 9.9926e-04
Validation auc = 0.734276
Epoch 1587
Loss = 6.2258e-02, PNorm = 364.9326, GNorm = 2.1894, lr_0 = 9.9926e-04
Validation auc = 0.727636
Epoch 1588
Loss = 6.5976e-02, PNorm = 365.0260, GNorm = 2.7782, lr_0 = 9.9926e-04
Validation auc = 0.709821
Epoch 1589
Loss = 2.5807e-03, PNorm = 365.1157, GNorm = 0.1943, lr_0 = 9.9926e-04
Loss = 1.4466e-02, PNorm = 365.1944, GNorm = 2.0960, lr_0 = 9.9926e-04
Validation auc = 0.707818
Epoch 1590
Loss = 7.3756e-02, PNorm = 365.2776, GNorm = 1.2347, lr_0 = 9.9926e-04
Validation auc = 0.712412
Epoch 1591
Loss = 1.8896e-02, PNorm = 365.3580, GNorm = 0.4713, lr_0 = 9.9926e-04
Validation auc = 0.713037
Epoch 1592
Loss = 9.5540e-03, PNorm = 365.4219, GNorm = 0.2386, lr_0 = 9.9925e-04
Validation auc = 0.704015
Epoch 1593
Loss = 1.2033e-02, PNorm = 365.4734, GNorm = 1.9901, lr_0 = 9.9925e-04
Validation auc = 0.705627
Epoch 1594
Loss = 7.2886e-02, PNorm = 365.5235, GNorm = 3.4262, lr_0 = 9.9925e-04
Validation auc = 0.705937
Epoch 1595
Loss = 2.4829e-02, PNorm = 365.5869, GNorm = 2.8124, lr_0 = 9.9925e-04
Validation auc = 0.700959
Epoch 1596
Loss = 4.3223e-02, PNorm = 365.6480, GNorm = 3.0077, lr_0 = 9.9925e-04
Validation auc = 0.690348
Epoch 1597
Loss = 1.8622e-02, PNorm = 365.7231, GNorm = 0.0401, lr_0 = 9.9925e-04
Validation auc = 0.700666
Epoch 1598
Loss = 7.1830e-02, PNorm = 365.8189, GNorm = 1.2826, lr_0 = 9.9925e-04
Validation auc = 0.713970
Epoch 1599
Loss = 1.9742e-02, PNorm = 365.9333, GNorm = 0.7219, lr_0 = 9.9925e-04
Loss = 3.2044e-02, PNorm = 366.0366, GNorm = 1.5150, lr_0 = 9.9925e-04
Validation auc = 0.733156
Epoch 1600
Loss = 2.0112e-02, PNorm = 366.1191, GNorm = 0.5315, lr_0 = 9.9925e-04
Validation auc = 0.745020
Epoch 1601
Loss = 1.0890e-02, PNorm = 366.1731, GNorm = 1.3867, lr_0 = 9.9925e-04
Validation auc = 0.742659
Epoch 1602
Loss = 2.9244e-02, PNorm = 366.2361, GNorm = 2.5819, lr_0 = 9.9925e-04
Validation auc = 0.727228
Epoch 1603
Loss = 5.1127e-02, PNorm = 366.3306, GNorm = 1.6280, lr_0 = 9.9925e-04
Validation auc = 0.706056
Epoch 1604
Loss = 5.3429e-02, PNorm = 366.4429, GNorm = 0.4090, lr_0 = 9.9925e-04
Validation auc = 0.700905
Epoch 1605
Loss = 3.3899e-02, PNorm = 366.5616, GNorm = 0.6165, lr_0 = 9.9924e-04
Validation auc = 0.706861
Epoch 1606
Loss = 1.3467e-02, PNorm = 366.6776, GNorm = 0.6572, lr_0 = 9.9924e-04
Validation auc = 0.705717
Epoch 1607
Loss = 2.2128e-01, PNorm = 366.7905, GNorm = 1.0415, lr_0 = 9.9924e-04
Validation auc = 0.704841
Epoch 1608
Loss = 4.5384e-02, PNorm = 366.9526, GNorm = 0.8522, lr_0 = 9.9924e-04
Validation auc = 0.703639
Epoch 1609
Loss = 9.5907e-02, PNorm = 367.1157, GNorm = 4.0661, lr_0 = 9.9924e-04
Loss = 6.7142e-02, PNorm = 367.2750, GNorm = 7.2437, lr_0 = 9.9924e-04
Validation auc = 0.714309
Epoch 1610
Loss = 5.9485e-02, PNorm = 367.4211, GNorm = 2.2071, lr_0 = 9.9924e-04
Validation auc = 0.708347
Epoch 1611
Loss = 7.6013e-02, PNorm = 367.5770, GNorm = 3.3574, lr_0 = 9.9924e-04
Validation auc = 0.703060
Epoch 1612
Loss = 4.8272e-02, PNorm = 367.7146, GNorm = 0.1827, lr_0 = 9.9924e-04
Validation auc = 0.707151
Epoch 1613
Loss = 3.7794e-02, PNorm = 367.8295, GNorm = 1.0999, lr_0 = 9.9924e-04
Validation auc = 0.703833
Epoch 1614
Loss = 2.6008e-02, PNorm = 367.9408, GNorm = 0.3871, lr_0 = 9.9924e-04
Validation auc = 0.703800
Epoch 1615
Loss = 5.4110e-02, PNorm = 368.0569, GNorm = 1.0345, lr_0 = 9.9924e-04
Validation auc = 0.713232
Epoch 1616
Loss = 3.2566e-02, PNorm = 368.1719, GNorm = 0.4544, lr_0 = 9.9924e-04
Validation auc = 0.725848
Epoch 1617
Loss = 7.4603e-03, PNorm = 368.2893, GNorm = 0.2237, lr_0 = 9.9924e-04
Validation auc = 0.722712
Epoch 1618
Loss = 1.5924e-02, PNorm = 368.4000, GNorm = 0.4057, lr_0 = 9.9924e-04
Validation auc = 0.718049
Epoch 1619
Loss = 2.9380e-03, PNorm = 368.5000, GNorm = 0.3830, lr_0 = 9.9923e-04
Loss = 4.3741e-02, PNorm = 368.5874, GNorm = 0.3379, lr_0 = 9.9923e-04
Validation auc = 0.715213
Epoch 1620
Loss = 6.1628e-02, PNorm = 368.6748, GNorm = 2.8631, lr_0 = 9.9923e-04
Validation auc = 0.713838
Epoch 1621
Loss = 4.5006e-02, PNorm = 368.7967, GNorm = 0.2103, lr_0 = 9.9923e-04
Validation auc = 0.699767
Epoch 1622
Loss = 2.4015e-02, PNorm = 368.9090, GNorm = 0.4894, lr_0 = 9.9923e-04
Validation auc = 0.697145
Epoch 1623
Loss = 1.3989e-02, PNorm = 369.0151, GNorm = 0.4681, lr_0 = 9.9923e-04
Validation auc = 0.715747
Epoch 1624
Loss = 1.7204e-02, PNorm = 369.0978, GNorm = 0.2438, lr_0 = 9.9923e-04
Validation auc = 0.715531
Epoch 1625
Loss = 3.6201e-02, PNorm = 369.1776, GNorm = 4.0952, lr_0 = 9.9923e-04
Validation auc = 0.704795
Epoch 1626
Loss = 1.3985e-02, PNorm = 369.2574, GNorm = 0.0556, lr_0 = 9.9923e-04
Validation auc = 0.702114
Epoch 1627
Loss = 3.0471e-02, PNorm = 369.3200, GNorm = 0.1675, lr_0 = 9.9923e-04
Validation auc = 0.699569
Epoch 1628
Loss = 3.9726e-02, PNorm = 369.3795, GNorm = 2.1223, lr_0 = 9.9923e-04
Validation auc = 0.701351
Epoch 1629
Loss = 8.5693e-03, PNorm = 369.4416, GNorm = 0.2574, lr_0 = 9.9923e-04
Loss = 2.5322e-02, PNorm = 369.5220, GNorm = 1.3523, lr_0 = 9.9923e-04
Validation auc = 0.704020
Epoch 1630
Loss = 2.4004e-02, PNorm = 369.5957, GNorm = 0.2745, lr_0 = 9.9923e-04
Validation auc = 0.710050
Epoch 1631
Loss = 2.8958e-02, PNorm = 369.6690, GNorm = 0.7468, lr_0 = 9.9922e-04
Validation auc = 0.706740
Epoch 1632
Loss = 2.2148e-02, PNorm = 369.7569, GNorm = 0.6250, lr_0 = 9.9922e-04
Validation auc = 0.700220
Epoch 1633
Loss = 1.2955e-02, PNorm = 369.8420, GNorm = 0.3214, lr_0 = 9.9922e-04
Validation auc = 0.698235
Epoch 1634
Loss = 2.3081e-02, PNorm = 369.9137, GNorm = 0.8461, lr_0 = 9.9922e-04
Validation auc = 0.715413
Epoch 1635
Loss = 5.5783e-02, PNorm = 370.0259, GNorm = 2.2365, lr_0 = 9.9922e-04
Validation auc = 0.730255
Epoch 1636
Loss = 5.0927e-02, PNorm = 370.1878, GNorm = 0.6357, lr_0 = 9.9922e-04
Validation auc = 0.748929
Epoch 1637
Loss = 1.4146e-03, PNorm = 370.3506, GNorm = 0.0704, lr_0 = 9.9922e-04
Validation auc = 0.744220
Epoch 1638
Loss = 3.1801e-02, PNorm = 370.4824, GNorm = 0.3579, lr_0 = 9.9922e-04
Validation auc = 0.735237
Epoch 1639
Loss = 3.7863e-03, PNorm = 370.6376, GNorm = 0.3028, lr_0 = 9.9922e-04
Loss = 4.4911e-02, PNorm = 370.7703, GNorm = 1.1619, lr_0 = 9.9922e-04
Validation auc = 0.715166
Epoch 1640
Loss = 5.0373e-02, PNorm = 370.9096, GNorm = 2.8206, lr_0 = 9.9922e-04
Validation auc = 0.705563
Epoch 1641
Loss = 6.3795e-02, PNorm = 371.0555, GNorm = 2.0382, lr_0 = 9.9922e-04
Validation auc = 0.719850
Epoch 1642
Loss = 1.0954e-01, PNorm = 371.2199, GNorm = 0.2300, lr_0 = 9.9922e-04
Validation auc = 0.712953
Epoch 1643
Loss = 6.1711e-02, PNorm = 371.4057, GNorm = 1.3963, lr_0 = 9.9922e-04
Validation auc = 0.707375
Epoch 1644
Loss = 4.7877e-02, PNorm = 371.5464, GNorm = 0.5065, lr_0 = 9.9922e-04
Validation auc = 0.711672
Epoch 1645
Loss = 4.3379e-02, PNorm = 371.6664, GNorm = 0.8549, lr_0 = 9.9921e-04
Validation auc = 0.714351
Epoch 1646
Loss = 3.0148e-02, PNorm = 371.8090, GNorm = 1.0816, lr_0 = 9.9921e-04
Validation auc = 0.696640
Epoch 1647
Loss = 6.3732e-02, PNorm = 371.9576, GNorm = 0.3054, lr_0 = 9.9921e-04
Validation auc = 0.683089
Epoch 1648
Loss = 2.9746e-02, PNorm = 372.0881, GNorm = 1.2160, lr_0 = 9.9921e-04
Validation auc = 0.696024
Epoch 1649
Loss = 2.2871e-02, PNorm = 372.1969, GNorm = 0.4146, lr_0 = 9.9921e-04
Loss = 3.4661e-02, PNorm = 372.2847, GNorm = 2.8451, lr_0 = 9.9921e-04
Validation auc = 0.693086
Epoch 1650
Loss = 2.7274e-02, PNorm = 372.3612, GNorm = 2.2067, lr_0 = 9.9921e-04
Validation auc = 0.697361
Epoch 1651
Loss = 4.6925e-02, PNorm = 372.4290, GNorm = 0.1855, lr_0 = 9.9921e-04
Validation auc = 0.715715
Epoch 1652
Loss = 2.1473e-02, PNorm = 372.5009, GNorm = 0.8099, lr_0 = 9.9921e-04
Validation auc = 0.724986
Epoch 1653
Loss = 2.5575e-02, PNorm = 372.5651, GNorm = 0.3137, lr_0 = 9.9921e-04
Validation auc = 0.735725
Epoch 1654
Loss = 2.1766e-02, PNorm = 372.7231, GNorm = 2.3236, lr_0 = 9.9921e-04
Validation auc = 0.742040
Epoch 1655
Loss = 5.5173e-02, PNorm = 372.8726, GNorm = 2.4106, lr_0 = 9.9921e-04
Validation auc = 0.751580
Epoch 1656
Loss = 4.1019e-02, PNorm = 373.0117, GNorm = 1.3981, lr_0 = 9.9921e-04
Validation auc = 0.752698
Epoch 1657
Loss = 8.1219e-02, PNorm = 373.1549, GNorm = 1.4549, lr_0 = 9.9921e-04
Validation auc = 0.754178
Epoch 1658
Loss = 2.0640e-02, PNorm = 373.2825, GNorm = 1.4577, lr_0 = 9.9921e-04
Validation auc = 0.754293
Epoch 1659
Loss = 1.1642e-01, PNorm = 373.3947, GNorm = 1.8402, lr_0 = 9.9920e-04
Loss = 2.8428e-02, PNorm = 373.5079, GNorm = 0.1575, lr_0 = 9.9920e-04
Validation auc = 0.759290
Epoch 1660
Loss = 5.5203e-02, PNorm = 373.6154, GNorm = 5.6491, lr_0 = 9.9920e-04
Validation auc = 0.760365
Epoch 1661
Loss = 3.7765e-02, PNorm = 373.7397, GNorm = 0.2526, lr_0 = 9.9920e-04
Validation auc = 0.749065
Epoch 1662
Loss = 6.7885e-02, PNorm = 373.8522, GNorm = 0.9575, lr_0 = 9.9920e-04
Validation auc = 0.730022
Epoch 1663
Loss = 2.4016e-02, PNorm = 373.9422, GNorm = 0.0264, lr_0 = 9.9920e-04
Validation auc = 0.728358
Epoch 1664
Loss = 8.0582e-03, PNorm = 374.0046, GNorm = 0.1142, lr_0 = 9.9920e-04
Validation auc = 0.733266
Epoch 1665
Loss = 4.3713e-02, PNorm = 374.1012, GNorm = 0.9314, lr_0 = 9.9920e-04
Validation auc = 0.737825
Epoch 1666
Loss = 7.5787e-02, PNorm = 374.2357, GNorm = 1.6087, lr_0 = 9.9920e-04
Validation auc = 0.736648
Epoch 1667
Loss = 9.4038e-02, PNorm = 374.3689, GNorm = 5.8583, lr_0 = 9.9920e-04
Validation auc = 0.718531
Epoch 1668
Loss = 4.3547e-02, PNorm = 374.5284, GNorm = 1.7375, lr_0 = 9.9920e-04
Validation auc = 0.704359
Epoch 1669
Loss = 1.1414e-02, PNorm = 374.6815, GNorm = 0.4151, lr_0 = 9.9920e-04
Loss = 5.4688e-02, PNorm = 374.8031, GNorm = 0.1682, lr_0 = 9.9920e-04
Validation auc = 0.714607
Epoch 1670
Loss = 4.5241e-02, PNorm = 374.9373, GNorm = 0.5661, lr_0 = 9.9920e-04
Validation auc = 0.733255
Epoch 1671
Loss = 3.5551e-02, PNorm = 375.0311, GNorm = 0.3714, lr_0 = 9.9919e-04
Validation auc = 0.741823
Epoch 1672
Loss = 1.8683e-02, PNorm = 375.1093, GNorm = 1.1127, lr_0 = 9.9919e-04
Validation auc = 0.751653
Epoch 1673
Loss = 4.2491e-02, PNorm = 375.1893, GNorm = 1.6696, lr_0 = 9.9919e-04
Validation auc = 0.751048
Epoch 1674
Loss = 1.7012e-02, PNorm = 375.2829, GNorm = 1.6295, lr_0 = 9.9919e-04
Validation auc = 0.751286
Epoch 1675
Loss = 3.2089e-02, PNorm = 375.3522, GNorm = 0.0610, lr_0 = 9.9919e-04
Validation auc = 0.746210
Epoch 1676
Loss = 2.0671e-02, PNorm = 375.4257, GNorm = 0.2706, lr_0 = 9.9919e-04
Validation auc = 0.723518
Epoch 1677
Loss = 2.3984e-02, PNorm = 375.5335, GNorm = 0.3457, lr_0 = 9.9919e-04
Validation auc = 0.716600
Epoch 1678
Loss = 3.3316e-02, PNorm = 375.6593, GNorm = 0.6941, lr_0 = 9.9919e-04
Validation auc = 0.728909
Epoch 1679
Loss = 1.8717e-03, PNorm = 375.7984, GNorm = 0.1537, lr_0 = 9.9919e-04
Loss = 7.2287e-02, PNorm = 375.9304, GNorm = 0.6799, lr_0 = 9.9919e-04
Validation auc = 0.720343
Epoch 1680
Loss = 5.6667e-02, PNorm = 376.0508, GNorm = 3.9963, lr_0 = 9.9919e-04
Validation auc = 0.719186
Epoch 1681
Loss = 4.2403e-02, PNorm = 376.1764, GNorm = 1.3712, lr_0 = 9.9919e-04
Validation auc = 0.725505
Epoch 1682
Loss = 5.9533e-02, PNorm = 376.3093, GNorm = 0.5585, lr_0 = 9.9919e-04
Validation auc = 0.737427
Epoch 1683
Loss = 3.6154e-02, PNorm = 376.4477, GNorm = 1.2553, lr_0 = 9.9919e-04
Validation auc = 0.726440
Epoch 1684
Loss = 4.8966e-02, PNorm = 376.5846, GNorm = 0.2988, lr_0 = 9.9919e-04
Validation auc = 0.719264
Epoch 1685
Loss = 8.0215e-02, PNorm = 376.7035, GNorm = 2.1007, lr_0 = 9.9918e-04
Validation auc = 0.718276
Epoch 1686
Loss = 4.2497e-02, PNorm = 376.8045, GNorm = 0.8372, lr_0 = 9.9918e-04
Validation auc = 0.708186
Epoch 1687
Loss = 2.0277e-02, PNorm = 376.9060, GNorm = 1.1588, lr_0 = 9.9918e-04
Validation auc = 0.705224
Epoch 1688
Loss = 1.4100e-02, PNorm = 377.0567, GNorm = 0.5537, lr_0 = 9.9918e-04
Validation auc = 0.704590
Epoch 1689
Loss = 2.7546e-02, PNorm = 377.2289, GNorm = 1.4374, lr_0 = 9.9918e-04
Loss = 4.2634e-02, PNorm = 377.3847, GNorm = 0.1643, lr_0 = 9.9918e-04
Validation auc = 0.714978
Epoch 1690
Loss = 9.4528e-02, PNorm = 377.5195, GNorm = 2.3246, lr_0 = 9.9918e-04
Validation auc = 0.713383
Epoch 1691
Loss = 2.8893e-02, PNorm = 377.6471, GNorm = 0.3476, lr_0 = 9.9918e-04
Validation auc = 0.703529
Epoch 1692
Loss = 1.1856e-01, PNorm = 377.8009, GNorm = 0.1014, lr_0 = 9.9918e-04
Validation auc = 0.695819
Epoch 1693
Loss = 4.5703e-02, PNorm = 377.9782, GNorm = 1.8208, lr_0 = 9.9918e-04
Validation auc = 0.694394
Epoch 1694
Loss = 4.7198e-02, PNorm = 378.1421, GNorm = 0.3485, lr_0 = 9.9918e-04
Validation auc = 0.690802
Epoch 1695
Loss = 9.8993e-02, PNorm = 378.3234, GNorm = 3.0639, lr_0 = 9.9918e-04
Validation auc = 0.677468
Epoch 1696
Loss = 3.0562e-02, PNorm = 378.5290, GNorm = 0.9486, lr_0 = 9.9918e-04
Validation auc = 0.681935
Epoch 1697
Loss = 3.8187e-02, PNorm = 378.7149, GNorm = 1.0330, lr_0 = 9.9918e-04
Validation auc = 0.712848
Epoch 1698
Loss = 1.6746e-02, PNorm = 378.9114, GNorm = 0.2002, lr_0 = 9.9917e-04
Validation auc = 0.729800
Epoch 1699
Loss = 1.0768e-02, PNorm = 379.0683, GNorm = 0.3532, lr_0 = 9.9917e-04
Loss = 6.6975e-02, PNorm = 379.2158, GNorm = 1.5198, lr_0 = 9.9917e-04
Validation auc = 0.741853
Epoch 1700
Loss = 5.4399e-02, PNorm = 379.3569, GNorm = 3.2974, lr_0 = 9.9917e-04
Validation auc = 0.739923
Epoch 1701
Loss = 4.7164e-02, PNorm = 379.4967, GNorm = 0.3152, lr_0 = 9.9917e-04
Validation auc = 0.739858
Epoch 1702
Loss = 6.5312e-02, PNorm = 379.6176, GNorm = 1.4927, lr_0 = 9.9917e-04
Validation auc = 0.741976
Epoch 1703
Loss = 4.5316e-02, PNorm = 379.7667, GNorm = 1.8160, lr_0 = 9.9917e-04
Validation auc = 0.727445
Epoch 1704
Loss = 2.7701e-02, PNorm = 379.9071, GNorm = 1.5812, lr_0 = 9.9917e-04
Validation auc = 0.737878
Epoch 1705
Loss = 3.0961e-02, PNorm = 380.0125, GNorm = 0.0563, lr_0 = 9.9917e-04
Validation auc = 0.740041
Epoch 1706
Loss = 7.4046e-03, PNorm = 380.1077, GNorm = 0.8882, lr_0 = 9.9917e-04
Validation auc = 0.738316
Epoch 1707
Loss = 1.7374e-02, PNorm = 380.1806, GNorm = 0.9059, lr_0 = 9.9917e-04
Validation auc = 0.730221
Epoch 1708
Loss = 2.2836e-02, PNorm = 380.2663, GNorm = 0.7091, lr_0 = 9.9917e-04
Validation auc = 0.728866
Epoch 1709
Loss = 1.2664e-01, PNorm = 380.3639, GNorm = 2.2708, lr_0 = 9.9917e-04
Loss = 3.4821e-02, PNorm = 380.4659, GNorm = 0.1882, lr_0 = 9.9917e-04
Validation auc = 0.723283
Epoch 1710
Loss = 1.9736e-02, PNorm = 380.5628, GNorm = 0.2035, lr_0 = 9.9917e-04
Validation auc = 0.720434
Epoch 1711
Loss = 6.2360e-02, PNorm = 380.6680, GNorm = 2.4979, lr_0 = 9.9916e-04
Validation auc = 0.710288
Epoch 1712
Loss = 1.3615e-01, PNorm = 380.8264, GNorm = 0.5874, lr_0 = 9.9916e-04
Validation auc = 0.705821
Epoch 1713
Loss = 8.2128e-02, PNorm = 381.0126, GNorm = 0.5079, lr_0 = 9.9916e-04
Validation auc = 0.713769
Epoch 1714
Loss = 7.9885e-02, PNorm = 381.2031, GNorm = 0.5876, lr_0 = 9.9916e-04
Validation auc = 0.707827
Epoch 1715
Loss = 2.2508e-02, PNorm = 381.3751, GNorm = 0.6956, lr_0 = 9.9916e-04
Validation auc = 0.722508
Epoch 1716
Loss = 7.1832e-02, PNorm = 381.4830, GNorm = 2.7559, lr_0 = 9.9916e-04
Validation auc = 0.725508
Epoch 1717
Loss = 1.4425e-01, PNorm = 381.5861, GNorm = 1.6883, lr_0 = 9.9916e-04
Validation auc = 0.731703
Epoch 1718
Loss = 1.0640e-01, PNorm = 381.7284, GNorm = 0.3472, lr_0 = 9.9916e-04
Validation auc = 0.732724
Epoch 1719
Loss = 9.6799e-03, PNorm = 381.8770, GNorm = 0.4262, lr_0 = 9.9916e-04
Loss = 4.0261e-02, PNorm = 382.0031, GNorm = 0.8720, lr_0 = 9.9916e-04
Validation auc = 0.735569
Epoch 1720
Loss = 5.1004e-02, PNorm = 382.1103, GNorm = 1.4125, lr_0 = 9.9916e-04
Validation auc = 0.726438
Epoch 1721
Loss = 4.2587e-02, PNorm = 382.2356, GNorm = 1.8086, lr_0 = 9.9916e-04
Validation auc = 0.733340
Epoch 1722
Loss = 1.1106e-01, PNorm = 382.3470, GNorm = 0.4010, lr_0 = 9.9916e-04
Validation auc = 0.734715
Epoch 1723
Loss = 2.4362e-02, PNorm = 382.4618, GNorm = 0.4974, lr_0 = 9.9916e-04
Validation auc = 0.724427
Epoch 1724
Loss = 4.1341e-02, PNorm = 382.5597, GNorm = 0.4155, lr_0 = 9.9915e-04
Validation auc = 0.694807
Epoch 1725
Loss = 9.0538e-02, PNorm = 382.6726, GNorm = 1.5061, lr_0 = 9.9915e-04
Validation auc = 0.699651
Epoch 1726
Loss = 6.5033e-02, PNorm = 382.7899, GNorm = 0.2638, lr_0 = 9.9915e-04
Validation auc = 0.705230
Epoch 1727
Loss = 7.8017e-02, PNorm = 382.9009, GNorm = 4.3755, lr_0 = 9.9915e-04
Validation auc = 0.720474
Epoch 1728
Loss = 4.9905e-02, PNorm = 383.0231, GNorm = 4.9682, lr_0 = 9.9915e-04
Validation auc = 0.705418
Epoch 1729
Loss = 2.2796e-02, PNorm = 383.2007, GNorm = 1.2717, lr_0 = 9.9915e-04
Loss = 8.4832e-02, PNorm = 383.3788, GNorm = 2.5277, lr_0 = 9.9915e-04
Validation auc = 0.695087
Epoch 1730
Loss = 5.9811e-02, PNorm = 383.5325, GNorm = 1.1849, lr_0 = 9.9915e-04
Validation auc = 0.695946
Epoch 1731
Loss = 1.1257e-01, PNorm = 383.7002, GNorm = 1.5367, lr_0 = 9.9915e-04
Validation auc = 0.714544
Epoch 1732
Loss = 4.9308e-02, PNorm = 383.8479, GNorm = 1.0347, lr_0 = 9.9915e-04
Validation auc = 0.733151
Epoch 1733
Loss = 3.7605e-02, PNorm = 383.9597, GNorm = 0.4336, lr_0 = 9.9915e-04
Validation auc = 0.740615
Epoch 1734
Loss = 2.7393e-02, PNorm = 384.0490, GNorm = 0.9781, lr_0 = 9.9915e-04
Validation auc = 0.738195
Epoch 1735
Loss = 1.1762e-02, PNorm = 384.1300, GNorm = 0.1816, lr_0 = 9.9915e-04
Validation auc = 0.730540
Epoch 1736
Loss = 4.3469e-02, PNorm = 384.2138, GNorm = 0.3826, lr_0 = 9.9915e-04
Validation auc = 0.709120
Epoch 1737
Loss = 3.5559e-02, PNorm = 384.3206, GNorm = 1.6103, lr_0 = 9.9915e-04
Validation auc = 0.703936
Epoch 1738
Loss = 1.0975e-02, PNorm = 384.4229, GNorm = 0.4470, lr_0 = 9.9914e-04
Validation auc = 0.723709
Epoch 1739
Loss = 2.0581e-02, PNorm = 384.5283, GNorm = 0.7465, lr_0 = 9.9914e-04
Loss = 7.4128e-02, PNorm = 384.6626, GNorm = 2.4739, lr_0 = 9.9914e-04
Validation auc = 0.745805
Epoch 1740
Loss = 7.8647e-02, PNorm = 384.7778, GNorm = 5.8755, lr_0 = 9.9914e-04
Validation auc = 0.754152
Epoch 1741
Loss = 1.8809e-02, PNorm = 384.8830, GNorm = 2.5228, lr_0 = 9.9914e-04
Validation auc = 0.751974
Epoch 1742
Loss = 6.2039e-03, PNorm = 384.9653, GNorm = 0.4079, lr_0 = 9.9914e-04
Validation auc = 0.760746
Epoch 1743
Loss = 4.9287e-02, PNorm = 385.0268, GNorm = 4.6834, lr_0 = 9.9914e-04
Validation auc = 0.754916
Epoch 1744
Loss = 1.8964e-02, PNorm = 385.1072, GNorm = 0.1173, lr_0 = 9.9914e-04
Validation auc = 0.728636
Epoch 1745
Loss = 2.1441e-02, PNorm = 385.2117, GNorm = 0.0274, lr_0 = 9.9914e-04
Validation auc = 0.729769
Epoch 1746
Loss = 8.3837e-02, PNorm = 385.3072, GNorm = 1.7179, lr_0 = 9.9914e-04
Validation auc = 0.728414
Epoch 1747
Loss = 1.3862e-01, PNorm = 385.4088, GNorm = 0.5956, lr_0 = 9.9914e-04
Validation auc = 0.738318
Epoch 1748
Loss = 9.3444e-02, PNorm = 385.5341, GNorm = 3.4431, lr_0 = 9.9914e-04
Validation auc = 0.735319
Epoch 1749
Loss = 1.1204e-01, PNorm = 385.6557, GNorm = 1.6042, lr_0 = 9.9914e-04
Loss = 4.6227e-02, PNorm = 385.7632, GNorm = 1.4089, lr_0 = 9.9914e-04
Validation auc = 0.730501
Epoch 1750
Loss = 4.4922e-02, PNorm = 385.8629, GNorm = 1.2898, lr_0 = 9.9913e-04
Validation auc = 0.736688
Epoch 1751
Loss = 4.0347e-02, PNorm = 385.9833, GNorm = 1.6864, lr_0 = 9.9913e-04
Validation auc = 0.742496
Epoch 1752
Loss = 2.2313e-02, PNorm = 386.0805, GNorm = 2.4258, lr_0 = 9.9913e-04
Validation auc = 0.739822
Epoch 1753
Loss = 2.6925e-02, PNorm = 386.2082, GNorm = 0.2933, lr_0 = 9.9913e-04
Validation auc = 0.720727
Epoch 1754
Loss = 9.3975e-02, PNorm = 386.3328, GNorm = 4.2585, lr_0 = 9.9913e-04
Validation auc = 0.739242
Epoch 1755
Loss = 1.5829e-02, PNorm = 386.4661, GNorm = 0.0768, lr_0 = 9.9913e-04
Validation auc = 0.744555
Epoch 1756
Loss = 2.7415e-02, PNorm = 386.5595, GNorm = 0.0428, lr_0 = 9.9913e-04
Validation auc = 0.738862
Epoch 1757
Loss = 2.0010e-02, PNorm = 386.6509, GNorm = 1.3560, lr_0 = 9.9913e-04
Validation auc = 0.718164
Epoch 1758
Loss = 5.9571e-03, PNorm = 386.7380, GNorm = 0.2328, lr_0 = 9.9913e-04
Validation auc = 0.721173
Epoch 1759
Loss = 2.5968e-03, PNorm = 386.8303, GNorm = 0.1130, lr_0 = 9.9913e-04
Loss = 2.0154e-02, PNorm = 386.9256, GNorm = 1.3740, lr_0 = 9.9913e-04
Validation auc = 0.722387
Epoch 1760
Loss = 1.7956e-02, PNorm = 387.0005, GNorm = 2.9212, lr_0 = 9.9913e-04
Validation auc = 0.714927
Epoch 1761
Loss = 7.1282e-02, PNorm = 387.0913, GNorm = 1.1317, lr_0 = 9.9913e-04
Validation auc = 0.713587
Epoch 1762
Loss = 3.0169e-02, PNorm = 387.1948, GNorm = 3.0681, lr_0 = 9.9913e-04
Validation auc = 0.710679
Epoch 1763
Loss = 2.8336e-02, PNorm = 387.2928, GNorm = 0.2748, lr_0 = 9.9913e-04
Validation auc = 0.715624
Epoch 1764
Loss = 4.6586e-02, PNorm = 387.3833, GNorm = 1.8058, lr_0 = 9.9912e-04
Validation auc = 0.720921
Epoch 1765
Loss = 2.1031e-02, PNorm = 387.4935, GNorm = 0.5947, lr_0 = 9.9912e-04
Validation auc = 0.722549
Epoch 1766
Loss = 3.3604e-02, PNorm = 387.5942, GNorm = 1.8553, lr_0 = 9.9912e-04
Validation auc = 0.730473
Epoch 1767
Loss = 1.3281e-02, PNorm = 387.6943, GNorm = 0.0621, lr_0 = 9.9912e-04
Validation auc = 0.729076
Epoch 1768
Loss = 6.0324e-03, PNorm = 387.7995, GNorm = 0.4258, lr_0 = 9.9912e-04
Validation auc = 0.725752
Epoch 1769
Loss = 1.2889e-01, PNorm = 387.8863, GNorm = 3.5424, lr_0 = 9.9912e-04
Loss = 6.5856e-02, PNorm = 388.0316, GNorm = 0.4594, lr_0 = 9.9912e-04
Validation auc = 0.742289
Epoch 1770
Loss = 5.2268e-02, PNorm = 388.1714, GNorm = 0.8184, lr_0 = 9.9912e-04
Validation auc = 0.750909
Epoch 1771
Loss = 4.6543e-02, PNorm = 388.3008, GNorm = 1.8783, lr_0 = 9.9912e-04
Validation auc = 0.754336
Epoch 1772
Loss = 3.0049e-02, PNorm = 388.4045, GNorm = 0.0610, lr_0 = 9.9912e-04
Validation auc = 0.751914
Epoch 1773
Loss = 5.6437e-02, PNorm = 388.5005, GNorm = 0.2598, lr_0 = 9.9912e-04
Validation auc = 0.754130
Epoch 1774
Loss = 4.4987e-02, PNorm = 388.6085, GNorm = 1.5090, lr_0 = 9.9912e-04
Validation auc = 0.751775
Epoch 1775
Loss = 6.0410e-02, PNorm = 388.7256, GNorm = 2.8305, lr_0 = 9.9912e-04
Validation auc = 0.743166
Epoch 1776
Loss = 3.9545e-02, PNorm = 388.8884, GNorm = 1.9083, lr_0 = 9.9912e-04
Validation auc = 0.750079
Epoch 1777
Loss = 5.8972e-02, PNorm = 389.0187, GNorm = 1.7565, lr_0 = 9.9911e-04
Validation auc = 0.746209
Epoch 1778
Loss = 2.7792e-01, PNorm = 389.1387, GNorm = 4.5244, lr_0 = 9.9911e-04
Validation auc = 0.741075
Epoch 1779
Loss = 3.9590e-03, PNorm = 389.2804, GNorm = 0.1258, lr_0 = 9.9911e-04
Loss = 6.6327e-02, PNorm = 389.4017, GNorm = 2.9767, lr_0 = 9.9911e-04
Validation auc = 0.730844
Epoch 1780
Loss = 9.6145e-02, PNorm = 389.5293, GNorm = 0.8540, lr_0 = 9.9911e-04
Validation auc = 0.728120
Epoch 1781
Loss = 3.4661e-02, PNorm = 389.6493, GNorm = 0.8930, lr_0 = 9.9911e-04
Validation auc = 0.733742
Epoch 1782
Loss = 5.5869e-02, PNorm = 389.7492, GNorm = 2.8235, lr_0 = 9.9911e-04
Validation auc = 0.739930
Epoch 1783
Loss = 2.3854e-02, PNorm = 389.8532, GNorm = 0.8581, lr_0 = 9.9911e-04
Validation auc = 0.741858
Epoch 1784
Loss = 7.4081e-02, PNorm = 389.9520, GNorm = 1.7927, lr_0 = 9.9911e-04
Validation auc = 0.730375
Epoch 1785
Loss = 1.9780e-02, PNorm = 390.0639, GNorm = 1.1253, lr_0 = 9.9911e-04
Validation auc = 0.733067
Epoch 1786
Loss = 2.0773e-02, PNorm = 390.1631, GNorm = 2.5056, lr_0 = 9.9911e-04
Validation auc = 0.756289
Epoch 1787
Loss = 1.4842e-02, PNorm = 390.2707, GNorm = 2.6405, lr_0 = 9.9911e-04
Validation auc = 0.763263
Epoch 1788
Loss = 1.6334e-01, PNorm = 390.4175, GNorm = 5.1405, lr_0 = 9.9911e-04
Validation auc = 0.753767
Epoch 1789
Loss = 5.4702e-02, PNorm = 390.5624, GNorm = 1.0873, lr_0 = 9.9911e-04
Loss = 5.3416e-02, PNorm = 390.6976, GNorm = 2.8514, lr_0 = 9.9911e-04
Validation auc = 0.734133
Epoch 1790
Loss = 7.1111e-02, PNorm = 390.8227, GNorm = 0.6854, lr_0 = 9.9910e-04
Validation auc = 0.734954
Epoch 1791
Loss = 6.7883e-02, PNorm = 390.9335, GNorm = 3.3887, lr_0 = 9.9910e-04
Validation auc = 0.741001
Epoch 1792
Loss = 6.2317e-02, PNorm = 391.0420, GNorm = 1.3805, lr_0 = 9.9910e-04
Validation auc = 0.743878
Epoch 1793
Loss = 5.6496e-02, PNorm = 391.1602, GNorm = 0.7188, lr_0 = 9.9910e-04
Validation auc = 0.745989
Epoch 1794
Loss = 6.3111e-02, PNorm = 391.2764, GNorm = 1.9135, lr_0 = 9.9910e-04
Validation auc = 0.730269
Epoch 1795
Loss = 1.1497e-01, PNorm = 391.3947, GNorm = 5.4298, lr_0 = 9.9910e-04
Validation auc = 0.700743
Epoch 1796
Loss = 9.2493e-02, PNorm = 391.5177, GNorm = 1.7634, lr_0 = 9.9910e-04
Validation auc = 0.698243
Epoch 1797
Loss = 1.0224e-01, PNorm = 391.6435, GNorm = 2.3326, lr_0 = 9.9910e-04
Validation auc = 0.710924
Epoch 1798
Loss = 1.6122e-02, PNorm = 391.7714, GNorm = 0.9108, lr_0 = 9.9910e-04
Validation auc = 0.716204
Epoch 1799
Loss = 1.5534e-01, PNorm = 391.8946, GNorm = 4.3888, lr_0 = 9.9910e-04
Loss = 3.4073e-02, PNorm = 392.0052, GNorm = 0.0587, lr_0 = 9.9910e-04
Validation auc = 0.713005
Epoch 1800
Loss = 3.2123e-02, PNorm = 392.1091, GNorm = 1.7291, lr_0 = 9.9910e-04
Validation auc = 0.711238
Epoch 1801
Loss = 2.5981e-02, PNorm = 392.1946, GNorm = 0.8370, lr_0 = 9.9910e-04
Validation auc = 0.711894
Epoch 1802
Loss = 4.4139e-02, PNorm = 392.2687, GNorm = 3.5298, lr_0 = 9.9910e-04
Validation auc = 0.701199
Epoch 1803
Loss = 3.8671e-02, PNorm = 392.3433, GNorm = 1.4425, lr_0 = 9.9909e-04
Validation auc = 0.696744
Epoch 1804
Loss = 6.3367e-02, PNorm = 392.4166, GNorm = 0.0239, lr_0 = 9.9909e-04
Validation auc = 0.710157
Epoch 1805
Loss = 2.4363e-02, PNorm = 392.5133, GNorm = 1.2987, lr_0 = 9.9909e-04
Validation auc = 0.722220
Epoch 1806
Loss = 9.9937e-02, PNorm = 392.6207, GNorm = 1.0345, lr_0 = 9.9909e-04
Validation auc = 0.718032
Epoch 1807
Loss = 7.8139e-02, PNorm = 392.7275, GNorm = 4.5221, lr_0 = 9.9909e-04
Validation auc = 0.713221
Epoch 1808
Loss = 7.1320e-02, PNorm = 392.8629, GNorm = 2.3886, lr_0 = 9.9909e-04
Validation auc = 0.714907
Epoch 1809
Loss = 3.3851e-02, PNorm = 392.9762, GNorm = 1.0783, lr_0 = 9.9909e-04
Loss = 6.8558e-02, PNorm = 393.1065, GNorm = 0.4547, lr_0 = 9.9909e-04
Validation auc = 0.720392
Epoch 1810
Loss = 4.3902e-02, PNorm = 393.2317, GNorm = 0.9660, lr_0 = 9.9909e-04
Validation auc = 0.713998
Epoch 1811
Loss = 1.8688e-02, PNorm = 393.3323, GNorm = 0.3584, lr_0 = 9.9909e-04
Validation auc = 0.712337
Epoch 1812
Loss = 4.3377e-02, PNorm = 393.4066, GNorm = 0.6638, lr_0 = 9.9909e-04
Validation auc = 0.717677
Epoch 1813
Loss = 3.4366e-02, PNorm = 393.4894, GNorm = 1.2763, lr_0 = 9.9909e-04
Validation auc = 0.721654
Epoch 1814
Loss = 6.8460e-02, PNorm = 393.5592, GNorm = 2.3075, lr_0 = 9.9909e-04
Validation auc = 0.715389
Epoch 1815
Loss = 3.0873e-02, PNorm = 393.6426, GNorm = 0.4527, lr_0 = 9.9909e-04
Validation auc = 0.707845
Epoch 1816
Loss = 1.4793e-02, PNorm = 393.7306, GNorm = 0.4480, lr_0 = 9.9909e-04
Validation auc = 0.713081
Epoch 1817
Loss = 1.2094e-02, PNorm = 393.8047, GNorm = 0.2048, lr_0 = 9.9908e-04
Validation auc = 0.717978
Epoch 1818
Loss = 9.9152e-04, PNorm = 393.8661, GNorm = 0.0395, lr_0 = 9.9908e-04
Validation auc = 0.720627
Epoch 1819
Loss = 3.7690e-03, PNorm = 393.9351, GNorm = 0.1601, lr_0 = 9.9908e-04
Loss = 1.3763e-02, PNorm = 393.9972, GNorm = 0.4061, lr_0 = 9.9908e-04
Validation auc = 0.718423
Epoch 1820
Loss = 4.5463e-02, PNorm = 394.0754, GNorm = 0.0000, lr_0 = 9.9908e-04
Validation auc = 0.716674
Epoch 1821
Loss = 8.5114e-02, PNorm = 394.1782, GNorm = 3.5782, lr_0 = 9.9908e-04
Validation auc = 0.716441
Epoch 1822
Loss = 5.8923e-02, PNorm = 394.3381, GNorm = 0.3887, lr_0 = 9.9908e-04
Validation auc = 0.721237
Epoch 1823
Loss = 5.9354e-02, PNorm = 394.4553, GNorm = 2.4006, lr_0 = 9.9908e-04
Validation auc = 0.719501
Epoch 1824
Loss = 2.9314e-02, PNorm = 394.5596, GNorm = 2.8951, lr_0 = 9.9908e-04
Validation auc = 0.716508
Epoch 1825
Loss = 4.2373e-02, PNorm = 394.6708, GNorm = 2.4242, lr_0 = 9.9908e-04
Validation auc = 0.718841
Epoch 1826
Loss = 3.1851e-02, PNorm = 394.7789, GNorm = 0.2593, lr_0 = 9.9908e-04
Validation auc = 0.719074
Epoch 1827
Loss = 2.4800e-02, PNorm = 394.8625, GNorm = 0.1995, lr_0 = 9.9908e-04
Validation auc = 0.716840
Epoch 1828
Loss = 6.7849e-03, PNorm = 394.9299, GNorm = 0.5905, lr_0 = 9.9908e-04
Validation auc = 0.723234
Epoch 1829
Loss = 2.2899e-02, PNorm = 394.9935, GNorm = 1.9201, lr_0 = 9.9908e-04
Loss = 5.1027e-02, PNorm = 395.1009, GNorm = 2.3261, lr_0 = 9.9908e-04
Validation auc = 0.726416
Epoch 1830
Loss = 3.2287e-02, PNorm = 395.2226, GNorm = 0.1286, lr_0 = 9.9907e-04
Validation auc = 0.725776
Epoch 1831
Loss = 5.9499e-02, PNorm = 395.3544, GNorm = 0.3932, lr_0 = 9.9907e-04
Validation auc = 0.725815
Epoch 1832
Loss = 5.4019e-02, PNorm = 395.4966, GNorm = 0.3577, lr_0 = 9.9907e-04
Validation auc = 0.733543
Epoch 1833
Loss = 9.5097e-02, PNorm = 395.6488, GNorm = 0.8777, lr_0 = 9.9907e-04
Validation auc = 0.740670
Epoch 1834
Loss = 7.1162e-02, PNorm = 395.8107, GNorm = 2.2480, lr_0 = 9.9907e-04
Validation auc = 0.740144
Epoch 1835
Loss = 8.5975e-02, PNorm = 395.9628, GNorm = 1.7509, lr_0 = 9.9907e-04
Validation auc = 0.723127
Epoch 1836
Loss = 3.3327e-02, PNorm = 396.0838, GNorm = 0.9476, lr_0 = 9.9907e-04
Validation auc = 0.714673
Epoch 1837
Loss = 8.1643e-02, PNorm = 396.1881, GNorm = 3.8208, lr_0 = 9.9907e-04
Validation auc = 0.702038
Epoch 1838
Loss = 1.0335e-02, PNorm = 396.3001, GNorm = 0.1167, lr_0 = 9.9907e-04
Validation auc = 0.717184
Epoch 1839
Loss = 3.8588e-02, PNorm = 396.4235, GNorm = 1.3977, lr_0 = 9.9907e-04
Loss = 2.7915e-02, PNorm = 396.5393, GNorm = 0.1638, lr_0 = 9.9907e-04
Validation auc = 0.734039
Epoch 1840
Loss = 1.8211e-02, PNorm = 396.6302, GNorm = 0.4558, lr_0 = 9.9907e-04
Validation auc = 0.739198
Epoch 1841
Loss = 4.6844e-02, PNorm = 396.7175, GNorm = 3.1965, lr_0 = 9.9907e-04
Validation auc = 0.733872
Epoch 1842
Loss = 1.4671e-02, PNorm = 396.8151, GNorm = 0.6204, lr_0 = 9.9907e-04
Validation auc = 0.736136
Epoch 1843
Loss = 4.9278e-02, PNorm = 396.9009, GNorm = 4.6899, lr_0 = 9.9906e-04
Validation auc = 0.729974
Epoch 1844
Loss = 6.8246e-02, PNorm = 396.9994, GNorm = 3.5692, lr_0 = 9.9906e-04
Validation auc = 0.728150
Epoch 1845
Loss = 5.3116e-02, PNorm = 397.1187, GNorm = 1.6848, lr_0 = 9.9906e-04
Validation auc = 0.724068
Epoch 1846
Loss = 2.9773e-02, PNorm = 397.2377, GNorm = 0.4056, lr_0 = 9.9906e-04
Validation auc = 0.726776
Epoch 1847
Loss = 3.6789e-02, PNorm = 397.3524, GNorm = 2.2335, lr_0 = 9.9906e-04
Validation auc = 0.732406
Epoch 1848
Loss = 5.1837e-02, PNorm = 397.4467, GNorm = 1.9163, lr_0 = 9.9906e-04
Validation auc = 0.726473
Epoch 1849
Loss = 9.8248e-03, PNorm = 397.5369, GNorm = 0.3009, lr_0 = 9.9906e-04
Loss = 7.3914e-03, PNorm = 397.6166, GNorm = 0.1282, lr_0 = 9.9906e-04
Validation auc = 0.712760
Epoch 1850
Loss = 5.4614e-02, PNorm = 397.6765, GNorm = 0.1310, lr_0 = 9.9906e-04
Validation auc = 0.715521
Epoch 1851
Loss = 1.5747e-02, PNorm = 397.7291, GNorm = 1.5479, lr_0 = 9.9906e-04
Validation auc = 0.722075
Epoch 1852
Loss = 3.9930e-02, PNorm = 397.7797, GNorm = 0.9213, lr_0 = 9.9906e-04
Validation auc = 0.725134
Epoch 1853
Loss = 3.4349e-02, PNorm = 397.8472, GNorm = 1.5678, lr_0 = 9.9906e-04
Validation auc = 0.730157
Epoch 1854
Loss = 5.1498e-02, PNorm = 397.9229, GNorm = 3.6000, lr_0 = 9.9906e-04
Validation auc = 0.720756
Epoch 1855
Loss = 2.3104e-02, PNorm = 398.0125, GNorm = 0.9640, lr_0 = 9.9906e-04
Validation auc = 0.705601
Epoch 1856
Loss = 1.9626e-02, PNorm = 398.1154, GNorm = 2.1499, lr_0 = 9.9906e-04
Validation auc = 0.701031
Epoch 1857
Loss = 1.3056e-01, PNorm = 398.2049, GNorm = 1.1695, lr_0 = 9.9905e-04
Validation auc = 0.703123
Epoch 1858
Loss = 3.4415e-02, PNorm = 398.3019, GNorm = 0.9375, lr_0 = 9.9905e-04
Validation auc = 0.700817
Epoch 1859
Loss = 2.0596e-02, PNorm = 398.4013, GNorm = 1.0757, lr_0 = 9.9905e-04
Loss = 4.9577e-02, PNorm = 398.4803, GNorm = 1.7723, lr_0 = 9.9905e-04
Validation auc = 0.707913
Epoch 1860
Loss = 2.6505e-02, PNorm = 398.5536, GNorm = 0.0821, lr_0 = 9.9905e-04
Validation auc = 0.717257
Epoch 1861
Loss = 4.6262e-02, PNorm = 398.6313, GNorm = 0.1774, lr_0 = 9.9905e-04
Validation auc = 0.721279
Epoch 1862
Loss = 7.3528e-02, PNorm = 398.7272, GNorm = 2.7348, lr_0 = 9.9905e-04
Validation auc = 0.711799
Epoch 1863
Loss = 1.3877e-02, PNorm = 398.8293, GNorm = 0.5280, lr_0 = 9.9905e-04
Validation auc = 0.714788
Epoch 1864
Loss = 1.4538e-02, PNorm = 398.9282, GNorm = 0.5683, lr_0 = 9.9905e-04
Validation auc = 0.711446
Epoch 1865
Loss = 4.1008e-02, PNorm = 399.0512, GNorm = 3.7948, lr_0 = 9.9905e-04
Validation auc = 0.726234
Epoch 1866
Loss = 3.8454e-02, PNorm = 399.1985, GNorm = 0.5001, lr_0 = 9.9905e-04
Validation auc = 0.731201
Epoch 1867
Loss = 2.4900e-02, PNorm = 399.3333, GNorm = 1.0523, lr_0 = 9.9905e-04
Validation auc = 0.734134
Epoch 1868
Loss = 2.5405e-03, PNorm = 399.4533, GNorm = 0.1645, lr_0 = 9.9905e-04
Validation auc = 0.731433
Epoch 1869
Loss = 2.1184e-02, PNorm = 399.5472, GNorm = 1.2897, lr_0 = 9.9905e-04
Loss = 5.6542e-02, PNorm = 399.6310, GNorm = 1.5632, lr_0 = 9.9904e-04
Validation auc = 0.722442
Epoch 1870
Loss = 2.3599e-02, PNorm = 399.7175, GNorm = 0.4936, lr_0 = 9.9904e-04
Validation auc = 0.728018
Epoch 1871
Loss = 8.2151e-02, PNorm = 399.8310, GNorm = 1.0756, lr_0 = 9.9904e-04
Validation auc = 0.722928
Epoch 1872
Loss = 8.3533e-02, PNorm = 399.9703, GNorm = 2.5768, lr_0 = 9.9904e-04
Validation auc = 0.725872
Epoch 1873
Loss = 1.4285e-02, PNorm = 400.0877, GNorm = 0.1824, lr_0 = 9.9904e-04
Validation auc = 0.722776
Epoch 1874
Loss = 5.3775e-02, PNorm = 400.1601, GNorm = 2.3210, lr_0 = 9.9904e-04
Validation auc = 0.720059
Epoch 1875
Loss = 5.6113e-02, PNorm = 400.2371, GNorm = 2.6117, lr_0 = 9.9904e-04
Validation auc = 0.718744
Epoch 1876
Loss = 3.7241e-02, PNorm = 400.3447, GNorm = 0.4378, lr_0 = 9.9904e-04
Validation auc = 0.701980
Epoch 1877
Loss = 7.3251e-02, PNorm = 400.4438, GNorm = 0.4468, lr_0 = 9.9904e-04
Validation auc = 0.714369
Epoch 1878
Loss = 3.6390e-03, PNorm = 400.5201, GNorm = 0.3669, lr_0 = 9.9904e-04
Validation auc = 0.721685
Epoch 1879
Loss = 2.2067e-03, PNorm = 400.5861, GNorm = 0.0933, lr_0 = 9.9904e-04
Loss = 2.8203e-02, PNorm = 400.6482, GNorm = 3.0493, lr_0 = 9.9904e-04
Validation auc = 0.726310
Epoch 1880
Loss = 8.7743e-02, PNorm = 400.7492, GNorm = 1.9569, lr_0 = 9.9904e-04
Validation auc = 0.714119
Epoch 1881
Loss = 5.5673e-02, PNorm = 400.9149, GNorm = 2.5363, lr_0 = 9.9904e-04
Validation auc = 0.706567
Epoch 1882
Loss = 4.1857e-02, PNorm = 401.0637, GNorm = 0.4661, lr_0 = 9.9904e-04
Validation auc = 0.695984
Epoch 1883
Loss = 1.4098e-02, PNorm = 401.1704, GNorm = 0.1049, lr_0 = 9.9903e-04
Validation auc = 0.696334
Epoch 1884
Loss = 4.7267e-02, PNorm = 401.2569, GNorm = 0.2314, lr_0 = 9.9903e-04
Validation auc = 0.703813
Epoch 1885
Loss = 8.2400e-03, PNorm = 401.3625, GNorm = 1.1162, lr_0 = 9.9903e-04
Validation auc = 0.714138
Epoch 1886
Loss = 2.3190e-02, PNorm = 401.4554, GNorm = 1.6629, lr_0 = 9.9903e-04
Validation auc = 0.715507
Epoch 1887
Loss = 3.3227e-02, PNorm = 401.5497, GNorm = 0.5600, lr_0 = 9.9903e-04
Validation auc = 0.714434
Epoch 1888
Loss = 1.8979e-02, PNorm = 401.6454, GNorm = 3.0819, lr_0 = 9.9903e-04
Validation auc = 0.710261
Epoch 1889
Loss = 3.5078e-02, PNorm = 401.7359, GNorm = 1.7070, lr_0 = 9.9903e-04
Loss = 3.6431e-02, PNorm = 401.8162, GNorm = 0.0683, lr_0 = 9.9903e-04
Validation auc = 0.698295
Epoch 1890
Loss = 3.4356e-02, PNorm = 401.8925, GNorm = 0.8381, lr_0 = 9.9903e-04
Validation auc = 0.697579
Epoch 1891
Loss = 1.7080e-02, PNorm = 401.9639, GNorm = 0.3565, lr_0 = 9.9903e-04
Validation auc = 0.708182
Epoch 1892
Loss = 4.1605e-02, PNorm = 402.0539, GNorm = 0.0132, lr_0 = 9.9903e-04
Validation auc = 0.694036
Epoch 1893
Loss = 1.2162e-01, PNorm = 402.1829, GNorm = 1.6481, lr_0 = 9.9903e-04
Validation auc = 0.708665
Epoch 1894
Loss = 3.7069e-02, PNorm = 402.3214, GNorm = 1.8850, lr_0 = 9.9903e-04
Validation auc = 0.718813
Epoch 1895
Loss = 2.3975e-02, PNorm = 402.4243, GNorm = 0.2602, lr_0 = 9.9903e-04
Validation auc = 0.720481
Epoch 1896
Loss = 2.2490e-02, PNorm = 402.5183, GNorm = 1.1739, lr_0 = 9.9902e-04
Validation auc = 0.727609
Epoch 1897
Loss = 3.4176e-02, PNorm = 402.6243, GNorm = 1.3510, lr_0 = 9.9902e-04
Validation auc = 0.727558
Epoch 1898
Loss = 9.4707e-02, PNorm = 402.7367, GNorm = 0.3480, lr_0 = 9.9902e-04
Validation auc = 0.727501
Epoch 1899
Loss = 7.8894e-02, PNorm = 402.8532, GNorm = 2.2940, lr_0 = 9.9902e-04
Loss = 5.0597e-02, PNorm = 402.9813, GNorm = 0.0312, lr_0 = 9.9902e-04
Validation auc = 0.712195
Epoch 1900
Loss = 4.0809e-02, PNorm = 403.1019, GNorm = 2.7212, lr_0 = 9.9902e-04
Validation auc = 0.713371
Epoch 1901
Loss = 3.1566e-02, PNorm = 403.2132, GNorm = 0.0809, lr_0 = 9.9902e-04
Validation auc = 0.694778
Epoch 1902
Loss = 3.5531e-02, PNorm = 403.3081, GNorm = 2.5873, lr_0 = 9.9902e-04
Validation auc = 0.680110
Epoch 1903
Loss = 3.3156e-02, PNorm = 403.4053, GNorm = 0.2345, lr_0 = 9.9902e-04
Validation auc = 0.688075
Epoch 1904
Loss = 4.3031e-02, PNorm = 403.5069, GNorm = 4.0479, lr_0 = 9.9902e-04
Validation auc = 0.700560
Epoch 1905
Loss = 7.0724e-02, PNorm = 403.6059, GNorm = 2.2777, lr_0 = 9.9902e-04
Validation auc = 0.703143
Epoch 1906
Loss = 3.7684e-03, PNorm = 403.7050, GNorm = 0.3754, lr_0 = 9.9902e-04
Validation auc = 0.700171
Epoch 1907
Loss = 2.7688e-02, PNorm = 403.7895, GNorm = 0.4313, lr_0 = 9.9902e-04
Validation auc = 0.721926
Epoch 1908
Loss = 4.1593e-02, PNorm = 403.8848, GNorm = 0.4028, lr_0 = 9.9902e-04
Validation auc = 0.729880
Epoch 1909
Loss = 8.2116e-03, PNorm = 403.9692, GNorm = 0.2534, lr_0 = 9.9902e-04
Loss = 5.6670e-02, PNorm = 404.0490, GNorm = 0.4358, lr_0 = 9.9901e-04
Validation auc = 0.722134
Epoch 1910
Loss = 6.7518e-02, PNorm = 404.1448, GNorm = 5.2549, lr_0 = 9.9901e-04
Validation auc = 0.709578
Epoch 1911
Loss = 6.8878e-02, PNorm = 404.2728, GNorm = 2.3748, lr_0 = 9.9901e-04
Validation auc = 0.700214
Epoch 1912
Loss = 5.0377e-02, PNorm = 404.3886, GNorm = 0.5430, lr_0 = 9.9901e-04
Validation auc = 0.701228
Epoch 1913
Loss = 1.0238e-02, PNorm = 404.4810, GNorm = 1.0769, lr_0 = 9.9901e-04
Validation auc = 0.705907
Epoch 1914
Loss = 8.8872e-02, PNorm = 404.5581, GNorm = 4.1914, lr_0 = 9.9901e-04
Validation auc = 0.722125
Epoch 1915
Loss = 7.2071e-02, PNorm = 404.6853, GNorm = 0.8866, lr_0 = 9.9901e-04
Validation auc = 0.719312
Epoch 1916
Loss = 3.7154e-02, PNorm = 404.8286, GNorm = 2.0532, lr_0 = 9.9901e-04
Validation auc = 0.714520
Epoch 1917
Loss = 4.2994e-02, PNorm = 404.9646, GNorm = 0.2907, lr_0 = 9.9901e-04
Validation auc = 0.704795
Epoch 1918
Loss = 4.8687e-02, PNorm = 405.0850, GNorm = 0.6729, lr_0 = 9.9901e-04
Validation auc = 0.701509
Epoch 1919
Loss = 2.9144e-02, PNorm = 405.2053, GNorm = 0.8774, lr_0 = 9.9901e-04
Loss = 3.6367e-02, PNorm = 405.3085, GNorm = 0.5713, lr_0 = 9.9901e-04
Validation auc = 0.714998
Epoch 1920
Loss = 4.5483e-02, PNorm = 405.4027, GNorm = 0.0480, lr_0 = 9.9901e-04
Validation auc = 0.719071
Epoch 1921
Loss = 2.1969e-02, PNorm = 405.4911, GNorm = 0.9267, lr_0 = 9.9901e-04
Validation auc = 0.716370
Epoch 1922
Loss = 2.6897e-02, PNorm = 405.5698, GNorm = 0.7628, lr_0 = 9.9900e-04
Validation auc = 0.719725
Epoch 1923
Loss = 4.7025e-02, PNorm = 405.6391, GNorm = 4.1103, lr_0 = 9.9900e-04
Validation auc = 0.724423
Epoch 1924
Loss = 1.9091e-02, PNorm = 405.7184, GNorm = 0.2379, lr_0 = 9.9900e-04
Validation auc = 0.724546
Epoch 1925
Loss = 2.8922e-02, PNorm = 405.8130, GNorm = 1.0458, lr_0 = 9.9900e-04
Validation auc = 0.727276
Epoch 1926
Loss = 8.7420e-02, PNorm = 405.9091, GNorm = 1.4036, lr_0 = 9.9900e-04
Validation auc = 0.720678
Epoch 1927
Loss = 2.1791e-02, PNorm = 405.9879, GNorm = 0.5922, lr_0 = 9.9900e-04
Validation auc = 0.713551
Epoch 1928
Loss = 6.3459e-03, PNorm = 406.0668, GNorm = 0.6838, lr_0 = 9.9900e-04
Validation auc = 0.718723
Epoch 1929
Loss = 2.5996e-02, PNorm = 406.1669, GNorm = 0.7479, lr_0 = 9.9900e-04
Loss = 7.2945e-02, PNorm = 406.3229, GNorm = 5.4739, lr_0 = 9.9900e-04
Validation auc = 0.720053
Epoch 1930
Loss = 2.9268e-02, PNorm = 406.4800, GNorm = 0.4741, lr_0 = 9.9900e-04
Validation auc = 0.707286
Epoch 1931
Loss = 2.2165e-02, PNorm = 406.5951, GNorm = 1.1398, lr_0 = 9.9900e-04
Validation auc = 0.703576
Epoch 1932
Loss = 5.3417e-02, PNorm = 406.6837, GNorm = 0.7562, lr_0 = 9.9900e-04
Validation auc = 0.704718
Epoch 1933
Loss = 8.9269e-03, PNorm = 406.7788, GNorm = 0.2246, lr_0 = 9.9900e-04
Validation auc = 0.702227
Epoch 1934
Loss = 3.7167e-02, PNorm = 406.8526, GNorm = 2.5466, lr_0 = 9.9900e-04
Validation auc = 0.691263
Epoch 1935
Loss = 5.5142e-02, PNorm = 406.9238, GNorm = 0.1744, lr_0 = 9.9900e-04
Validation auc = 0.692789
Epoch 1936
Loss = 2.2616e-02, PNorm = 406.9907, GNorm = 0.0687, lr_0 = 9.9899e-04
Validation auc = 0.691252
Epoch 1937
Loss = 1.3646e-02, PNorm = 407.0530, GNorm = 0.1631, lr_0 = 9.9899e-04
Validation auc = 0.687618
Epoch 1938
Loss = 1.6194e-02, PNorm = 407.1260, GNorm = 0.0732, lr_0 = 9.9899e-04
Validation auc = 0.693013
Epoch 1939
Loss = 5.2826e-03, PNorm = 407.2090, GNorm = 0.4271, lr_0 = 9.9899e-04
Loss = 8.3631e-03, PNorm = 407.2811, GNorm = 0.1328, lr_0 = 9.9899e-04
Validation auc = 0.692903
Epoch 1940
Loss = 2.6310e-02, PNorm = 407.3472, GNorm = 2.9443, lr_0 = 9.9899e-04
Validation auc = 0.687513
Epoch 1941
Loss = 2.2565e-02, PNorm = 407.4304, GNorm = 0.0601, lr_0 = 9.9899e-04
Validation auc = 0.686693
Epoch 1942
Loss = 7.5950e-02, PNorm = 407.5105, GNorm = 0.3022, lr_0 = 9.9899e-04
Validation auc = 0.686527
Epoch 1943
Loss = 1.6252e-02, PNorm = 407.6200, GNorm = 1.0370, lr_0 = 9.9899e-04
Validation auc = 0.699891
Epoch 1944
Loss = 1.3583e-02, PNorm = 407.7425, GNorm = 0.0756, lr_0 = 9.9899e-04
Validation auc = 0.710668
Epoch 1945
Loss = 4.0149e-02, PNorm = 407.8379, GNorm = 0.0229, lr_0 = 9.9899e-04
Validation auc = 0.719426
Epoch 1946
Loss = 2.5299e-01, PNorm = 407.9261, GNorm = 0.2559, lr_0 = 9.9899e-04
Validation auc = 0.699560
Epoch 1947
Loss = 8.9848e-02, PNorm = 408.0501, GNorm = 0.8072, lr_0 = 9.9899e-04
Validation auc = 0.699036
Epoch 1948
Loss = 1.5473e-01, PNorm = 408.1701, GNorm = 4.6652, lr_0 = 9.9899e-04
Validation auc = 0.705223
Epoch 1949
Loss = 2.5738e-02, PNorm = 408.2821, GNorm = 0.4864, lr_0 = 9.9898e-04
Loss = 1.1495e-01, PNorm = 408.4054, GNorm = 3.7453, lr_0 = 9.9898e-04
Validation auc = 0.700531
Epoch 1950
Loss = 6.1769e-02, PNorm = 408.5824, GNorm = 0.2424, lr_0 = 9.9898e-04
Validation auc = 0.702686
Epoch 1951
Loss = 5.9049e-02, PNorm = 408.7235, GNorm = 0.7347, lr_0 = 9.9898e-04
Validation auc = 0.709875
Epoch 1952
Loss = 1.9746e-02, PNorm = 408.8693, GNorm = 0.2336, lr_0 = 9.9898e-04
Validation auc = 0.718827
Epoch 1953
Loss = 3.1259e-02, PNorm = 408.9827, GNorm = 1.3090, lr_0 = 9.9898e-04
Validation auc = 0.720650
Epoch 1954
Loss = 6.5081e-02, PNorm = 409.1077, GNorm = 0.1397, lr_0 = 9.9898e-04
Validation auc = 0.726711
Epoch 1955
Loss = 3.3464e-02, PNorm = 409.2445, GNorm = 0.0206, lr_0 = 9.9898e-04
Validation auc = 0.719724
Epoch 1956
Loss = 7.5888e-02, PNorm = 409.3647, GNorm = 3.1562, lr_0 = 9.9898e-04
Validation auc = 0.705332
Epoch 1957
Loss = 2.1147e-02, PNorm = 409.5049, GNorm = 0.5162, lr_0 = 9.9898e-04
Validation auc = 0.693227
Epoch 1958
Loss = 4.7343e-02, PNorm = 409.6394, GNorm = 2.3994, lr_0 = 9.9898e-04
Validation auc = 0.698743
Epoch 1959
Loss = 1.0820e-02, PNorm = 409.7525, GNorm = 0.4530, lr_0 = 9.9898e-04
Loss = 6.8922e-02, PNorm = 409.8506, GNorm = 2.5730, lr_0 = 9.9898e-04
Validation auc = 0.711027
Epoch 1960
Loss = 5.3086e-02, PNorm = 409.9690, GNorm = 0.2211, lr_0 = 9.9898e-04
Validation auc = 0.705908
Epoch 1961
Loss = 9.7353e-02, PNorm = 410.1202, GNorm = 0.2638, lr_0 = 9.9898e-04
Validation auc = 0.699784
Epoch 1962
Loss = 8.6667e-02, PNorm = 410.2797, GNorm = 0.6573, lr_0 = 9.9897e-04
Validation auc = 0.698963
Epoch 1963
Loss = 7.2200e-02, PNorm = 410.4123, GNorm = 1.7948, lr_0 = 9.9897e-04
Validation auc = 0.705726
Epoch 1964
Loss = 8.1238e-02, PNorm = 410.5256, GNorm = 2.7366, lr_0 = 9.9897e-04
Validation auc = 0.723550
Epoch 1965
Loss = 2.0929e-02, PNorm = 410.6422, GNorm = 0.5599, lr_0 = 9.9897e-04
Validation auc = 0.734601
Epoch 1966
Loss = 1.0777e-01, PNorm = 410.7344, GNorm = 1.1923, lr_0 = 9.9897e-04
Validation auc = 0.736652
Epoch 1967
Loss = 1.2572e-02, PNorm = 410.8290, GNorm = 0.1576, lr_0 = 9.9897e-04
Validation auc = 0.727153
Epoch 1968
Loss = 4.2379e-02, PNorm = 410.9207, GNorm = 0.7386, lr_0 = 9.9897e-04
Validation auc = 0.710164
Epoch 1969
Loss = 8.0536e-02, PNorm = 411.0357, GNorm = 3.1799, lr_0 = 9.9897e-04
Loss = 4.5600e-02, PNorm = 411.1760, GNorm = 4.3223, lr_0 = 9.9897e-04
Validation auc = 0.699915
Epoch 1970
Loss = 7.2272e-02, PNorm = 411.3125, GNorm = 1.7809, lr_0 = 9.9897e-04
Validation auc = 0.700629
Epoch 1971
Loss = 4.3796e-02, PNorm = 411.4318, GNorm = 4.9798, lr_0 = 9.9897e-04
Validation auc = 0.696958
Epoch 1972
Loss = 8.2107e-02, PNorm = 411.5797, GNorm = 2.8358, lr_0 = 9.9897e-04
Validation auc = 0.708387
Epoch 1973
Loss = 2.1634e-02, PNorm = 411.7358, GNorm = 0.9615, lr_0 = 9.9897e-04
Validation auc = 0.706170
Epoch 1974
Loss = 8.8361e-02, PNorm = 411.8719, GNorm = 3.9505, lr_0 = 9.9897e-04
Validation auc = 0.689039
Epoch 1975
Loss = 7.8727e-02, PNorm = 412.0267, GNorm = 0.3967, lr_0 = 9.9896e-04
Validation auc = 0.711177
Epoch 1976
Loss = 1.0597e-01, PNorm = 412.1880, GNorm = 2.5689, lr_0 = 9.9896e-04
Validation auc = 0.737480
Epoch 1977
Loss = 5.6361e-02, PNorm = 412.3384, GNorm = 0.5338, lr_0 = 9.9896e-04
Validation auc = 0.748594
Epoch 1978
Loss = 1.5703e-02, PNorm = 412.4760, GNorm = 0.1797, lr_0 = 9.9896e-04
Validation auc = 0.730666
Epoch 1979
Loss = 4.3580e-02, PNorm = 412.6229, GNorm = 1.3485, lr_0 = 9.9896e-04
Loss = 3.7294e-02, PNorm = 412.7482, GNorm = 0.3748, lr_0 = 9.9896e-04
Validation auc = 0.729441
Epoch 1980
Loss = 1.2420e-01, PNorm = 412.8669, GNorm = 3.8942, lr_0 = 9.9896e-04
Validation auc = 0.734390
Epoch 1981
Loss = 8.2533e-02, PNorm = 413.0194, GNorm = 0.7786, lr_0 = 9.9896e-04
Validation auc = 0.737662
Epoch 1982
Loss = 5.3813e-02, PNorm = 413.1622, GNorm = 0.8392, lr_0 = 9.9896e-04
Validation auc = 0.742863
Epoch 1983
Loss = 1.6443e-02, PNorm = 413.2757, GNorm = 0.3179, lr_0 = 9.9896e-04
Validation auc = 0.748968
Epoch 1984
Loss = 3.8004e-02, PNorm = 413.3446, GNorm = 2.4405, lr_0 = 9.9896e-04
Validation auc = 0.734581
Epoch 1985
Loss = 5.7997e-02, PNorm = 413.4033, GNorm = 3.2199, lr_0 = 9.9896e-04
Validation auc = 0.720435
Epoch 1986
Loss = 3.4507e-02, PNorm = 413.4763, GNorm = 0.8519, lr_0 = 9.9896e-04
Validation auc = 0.723265
Epoch 1987
Loss = 2.5600e-02, PNorm = 413.5943, GNorm = 1.0592, lr_0 = 9.9896e-04
Validation auc = 0.719195
Epoch 1988
Loss = 2.1791e-02, PNorm = 413.7411, GNorm = 0.8849, lr_0 = 9.9896e-04
Validation auc = 0.722397
Epoch 1989
Loss = 8.7821e-03, PNorm = 413.8678, GNorm = 0.4326, lr_0 = 9.9895e-04
Loss = 5.5359e-02, PNorm = 413.9763, GNorm = 1.5297, lr_0 = 9.9895e-04
Validation auc = 0.723788
Epoch 1990
Loss = 4.0665e-02, PNorm = 414.0868, GNorm = 1.1466, lr_0 = 9.9895e-04
Validation auc = 0.717907
Epoch 1991
Loss = 1.8135e-02, PNorm = 414.1751, GNorm = 0.8819, lr_0 = 9.9895e-04
Validation auc = 0.724112
Epoch 1992
Loss = 3.0009e-02, PNorm = 414.2390, GNorm = 0.0196, lr_0 = 9.9895e-04
Validation auc = 0.732627
Epoch 1993
Loss = 9.8497e-03, PNorm = 414.3090, GNorm = 0.2454, lr_0 = 9.9895e-04
Validation auc = 0.736217
Epoch 1994
Loss = 4.2784e-02, PNorm = 414.3603, GNorm = 3.5304, lr_0 = 9.9895e-04
Validation auc = 0.730485
Epoch 1995
Loss = 8.8751e-03, PNorm = 414.4186, GNorm = 0.5175, lr_0 = 9.9895e-04
Validation auc = 0.728100
Epoch 1996
Loss = 2.5248e-02, PNorm = 414.4754, GNorm = 4.7917, lr_0 = 9.9895e-04
Validation auc = 0.741552
Epoch 1997
Loss = 2.0454e-02, PNorm = 414.5686, GNorm = 1.3119, lr_0 = 9.9895e-04
Validation auc = 0.735779
Epoch 1998
Loss = 6.6271e-03, PNorm = 414.6942, GNorm = 0.0244, lr_0 = 9.9895e-04
Validation auc = 0.732933
Epoch 1999
Loss = 1.0576e-02, PNorm = 414.7981, GNorm = 0.5421, lr_0 = 9.9895e-04
Loss = 9.9632e-02, PNorm = 414.9224, GNorm = 2.6838, lr_0 = 9.9895e-04
Validation auc = 0.723780
Epoch 2000
Loss = 5.9509e-02, PNorm = 415.0763, GNorm = 0.4279, lr_0 = 9.9895e-04
Validation auc = 0.714633
Epoch 2001
Loss = 7.2721e-02, PNorm = 415.2101, GNorm = 3.0141, lr_0 = 9.9895e-04
Validation auc = 0.714844
Epoch 2002
Loss = 4.2169e-02, PNorm = 415.3183, GNorm = 2.2689, lr_0 = 9.9894e-04
Validation auc = 0.708439
Epoch 2003
Loss = 3.7658e-02, PNorm = 415.4171, GNorm = 0.7819, lr_0 = 9.9894e-04
Validation auc = 0.723131
Epoch 2004
Loss = 9.1702e-02, PNorm = 415.5187, GNorm = 2.4013, lr_0 = 9.9894e-04
Validation auc = 0.731694
Epoch 2005
Loss = 8.1755e-03, PNorm = 415.6362, GNorm = 0.7616, lr_0 = 9.9894e-04
Validation auc = 0.744727
Epoch 2006
Loss = 4.4078e-02, PNorm = 415.7454, GNorm = 0.5994, lr_0 = 9.9894e-04
Validation auc = 0.740765
Epoch 2007
Loss = 1.9819e-02, PNorm = 415.8715, GNorm = 3.2736, lr_0 = 9.9894e-04
Validation auc = 0.733574
Epoch 2008
Loss = 1.5492e-02, PNorm = 415.9870, GNorm = 0.3814, lr_0 = 9.9894e-04
Validation auc = 0.720017
Epoch 2009
Loss = 6.8887e-03, PNorm = 416.0844, GNorm = 0.6375, lr_0 = 9.9894e-04
Loss = 3.3506e-02, PNorm = 416.1811, GNorm = 5.5004, lr_0 = 9.9894e-04
Validation auc = 0.713452
Epoch 2010
Loss = 4.5041e-02, PNorm = 416.2766, GNorm = 0.3557, lr_0 = 9.9894e-04
Validation auc = 0.712122
Epoch 2011
Loss = 2.6836e-02, PNorm = 416.3838, GNorm = 1.4889, lr_0 = 9.9894e-04
Validation auc = 0.704763
Epoch 2012
Loss = 1.6296e-02, PNorm = 416.4833, GNorm = 0.2089, lr_0 = 9.9894e-04
Validation auc = 0.700672
Epoch 2013
Loss = 2.5639e-02, PNorm = 416.5833, GNorm = 0.7310, lr_0 = 9.9894e-04
Validation auc = 0.704806
Epoch 2014
Loss = 8.8437e-02, PNorm = 416.6826, GNorm = 0.7883, lr_0 = 9.9894e-04
Validation auc = 0.724294
Epoch 2015
Loss = 1.3228e-01, PNorm = 416.7900, GNorm = 0.2530, lr_0 = 9.9893e-04
Validation auc = 0.727084
Epoch 2016
Loss = 1.1517e-01, PNorm = 416.9186, GNorm = 3.9149, lr_0 = 9.9893e-04
Validation auc = 0.708373
Epoch 2017
Loss = 6.2319e-02, PNorm = 417.0517, GNorm = 1.8249, lr_0 = 9.9893e-04
Validation auc = 0.703870
Epoch 2018
Loss = 2.7362e-02, PNorm = 417.1764, GNorm = 0.9184, lr_0 = 9.9893e-04
Validation auc = 0.716107
Epoch 2019
Loss = 5.9843e-03, PNorm = 417.2649, GNorm = 0.2026, lr_0 = 9.9893e-04
Loss = 5.3962e-02, PNorm = 417.3383, GNorm = 1.7925, lr_0 = 9.9893e-04
Validation auc = 0.726929
Epoch 2020
Loss = 1.9134e-02, PNorm = 417.3996, GNorm = 2.8717, lr_0 = 9.9893e-04
Validation auc = 0.734770
Epoch 2021
Loss = 2.2030e-02, PNorm = 417.4474, GNorm = 0.6312, lr_0 = 9.9893e-04
Validation auc = 0.735672
Epoch 2022
Loss = 1.3818e-02, PNorm = 417.4927, GNorm = 1.3930, lr_0 = 9.9893e-04
Validation auc = 0.731454
Epoch 2023
Loss = 1.7047e-02, PNorm = 417.5408, GNorm = 0.0686, lr_0 = 9.9893e-04
Validation auc = 0.722555
Epoch 2024
Loss = 5.8812e-02, PNorm = 417.6044, GNorm = 1.5790, lr_0 = 9.9893e-04
Validation auc = 0.728614
Epoch 2025
Loss = 2.7726e-01, PNorm = 417.6856, GNorm = 0.1743, lr_0 = 9.9893e-04
Validation auc = 0.734105
Epoch 2026
Loss = 3.4104e-02, PNorm = 417.7873, GNorm = 0.2282, lr_0 = 9.9893e-04
Validation auc = 0.735802
Epoch 2027
Loss = 1.9755e-03, PNorm = 417.8626, GNorm = 0.1837, lr_0 = 9.9893e-04
Validation auc = 0.737909
Epoch 2028
Loss = 8.1025e-03, PNorm = 417.9171, GNorm = 0.1193, lr_0 = 9.9893e-04
Validation auc = 0.751245
Epoch 2029
Loss = 1.6875e-02, PNorm = 417.9755, GNorm = 0.4905, lr_0 = 9.9892e-04
Loss = 1.9197e-02, PNorm = 418.0608, GNorm = 0.2472, lr_0 = 9.9892e-04
Validation auc = 0.754989
Epoch 2030
Loss = 4.8431e-02, PNorm = 418.1363, GNorm = 0.1191, lr_0 = 9.9892e-04
Validation auc = 0.753921
Epoch 2031
Loss = 5.4860e-02, PNorm = 418.2201, GNorm = 2.1030, lr_0 = 9.9892e-04
Validation auc = 0.739390
Epoch 2032
Loss = 3.5503e-02, PNorm = 418.3147, GNorm = 1.2358, lr_0 = 9.9892e-04
Validation auc = 0.725958
Epoch 2033
Loss = 1.5170e-02, PNorm = 418.3959, GNorm = 0.0870, lr_0 = 9.9892e-04
Validation auc = 0.724457
Epoch 2034
Loss = 1.4717e-02, PNorm = 418.4579, GNorm = 1.7714, lr_0 = 9.9892e-04
Validation auc = 0.730907
Epoch 2035
Loss = 9.4188e-03, PNorm = 418.5176, GNorm = 0.4875, lr_0 = 9.9892e-04
Validation auc = 0.737867
Epoch 2036
Loss = 2.6019e-02, PNorm = 418.5724, GNorm = 0.1245, lr_0 = 9.9892e-04
Validation auc = 0.736495
Epoch 2037
Loss = 1.4239e-02, PNorm = 418.6477, GNorm = 2.0543, lr_0 = 9.9892e-04
Validation auc = 0.744248
Epoch 2038
Loss = 1.3877e-02, PNorm = 418.7598, GNorm = 0.4069, lr_0 = 9.9892e-04
Validation auc = 0.753397
Epoch 2039
Loss = 6.3941e-04, PNorm = 418.8741, GNorm = 0.0286, lr_0 = 9.9892e-04
Loss = 9.3241e-02, PNorm = 418.9826, GNorm = 3.4020, lr_0 = 9.9892e-04
Validation auc = 0.745677
Epoch 2040
Loss = 5.8600e-02, PNorm = 419.1284, GNorm = 3.1778, lr_0 = 9.9892e-04
Validation auc = 0.757019
Epoch 2041
Loss = 5.8818e-02, PNorm = 419.2607, GNorm = 0.2968, lr_0 = 9.9891e-04
Validation auc = 0.759713
Epoch 2042
Loss = 5.3769e-02, PNorm = 419.3777, GNorm = 0.9628, lr_0 = 9.9891e-04
Validation auc = 0.754936
Epoch 2043
Loss = 1.1118e-01, PNorm = 419.4902, GNorm = 4.6299, lr_0 = 9.9891e-04
Validation auc = 0.733270
Epoch 2044
Loss = 3.0139e-02, PNorm = 419.6070, GNorm = 0.3328, lr_0 = 9.9891e-04
Validation auc = 0.739605
Epoch 2045
Loss = 2.4118e-02, PNorm = 419.7142, GNorm = 0.9064, lr_0 = 9.9891e-04
Validation auc = 0.735079
Epoch 2046
Loss = 1.8642e-01, PNorm = 419.7956, GNorm = 2.6064, lr_0 = 9.9891e-04
Validation auc = 0.730090
Epoch 2047
Loss = 8.7832e-02, PNorm = 419.8757, GNorm = 1.5396, lr_0 = 9.9891e-04
Validation auc = 0.741919
Epoch 2048
Loss = 6.2304e-03, PNorm = 419.9557, GNorm = 0.1141, lr_0 = 9.9891e-04
Validation auc = 0.738569
Epoch 2049
Loss = 1.1450e-03, PNorm = 420.0428, GNorm = 0.0764, lr_0 = 9.9891e-04
Loss = 2.7528e-02, PNorm = 420.1409, GNorm = 1.6362, lr_0 = 9.9891e-04
Validation auc = 0.741775
Epoch 2050
Loss = 4.6320e-02, PNorm = 420.2427, GNorm = 1.8993, lr_0 = 9.9891e-04
Validation auc = 0.743501
Epoch 2051
Loss = 7.9887e-02, PNorm = 420.3460, GNorm = 2.9104, lr_0 = 9.9891e-04
Validation auc = 0.716508
Epoch 2052
Loss = 6.5079e-02, PNorm = 420.4581, GNorm = 0.7521, lr_0 = 9.9891e-04
Validation auc = 0.699827
Epoch 2053
Loss = 3.3263e-02, PNorm = 420.5494, GNorm = 1.9044, lr_0 = 9.9891e-04
Validation auc = 0.700851
Epoch 2054
Loss = 3.4080e-02, PNorm = 420.6239, GNorm = 2.3146, lr_0 = 9.9891e-04
Validation auc = 0.710756
Epoch 2055
Loss = 2.0833e-02, PNorm = 420.7063, GNorm = 0.2956, lr_0 = 9.9890e-04
Validation auc = 0.731985
Epoch 2056
Loss = 4.4959e-02, PNorm = 420.7957, GNorm = 0.2061, lr_0 = 9.9890e-04
Validation auc = 0.714266
Epoch 2057
Loss = 2.1434e-02, PNorm = 420.8727, GNorm = 0.5630, lr_0 = 9.9890e-04
Validation auc = 0.705067
Epoch 2058
Loss = 1.5830e-02, PNorm = 420.9404, GNorm = 0.3382, lr_0 = 9.9890e-04
Validation auc = 0.709811
Epoch 2059
Loss = 2.2036e-02, PNorm = 421.0035, GNorm = 0.9111, lr_0 = 9.9890e-04
Loss = 5.3898e-02, PNorm = 421.0596, GNorm = 0.2389, lr_0 = 9.9890e-04
Validation auc = 0.703271
Epoch 2060
Loss = 7.5485e-02, PNorm = 421.1308, GNorm = 2.0426, lr_0 = 9.9890e-04
Validation auc = 0.703238
Epoch 2061
Loss = 3.1302e-02, PNorm = 421.2287, GNorm = 0.1794, lr_0 = 9.9890e-04
Validation auc = 0.714500
Epoch 2062
Loss = 1.6495e-02, PNorm = 421.3222, GNorm = 0.9557, lr_0 = 9.9890e-04
Validation auc = 0.725351
Epoch 2063
Loss = 9.2264e-02, PNorm = 421.4203, GNorm = 0.7301, lr_0 = 9.9890e-04
Validation auc = 0.728441
Epoch 2064
Loss = 5.2203e-02, PNorm = 421.5182, GNorm = 3.4904, lr_0 = 9.9890e-04
Validation auc = 0.734290
Epoch 2065
Loss = 2.1362e-02, PNorm = 421.6032, GNorm = 0.6168, lr_0 = 9.9890e-04
Validation auc = 0.741950
Epoch 2066
Loss = 3.7510e-03, PNorm = 421.6684, GNorm = 0.4425, lr_0 = 9.9890e-04
Validation auc = 0.734365
Epoch 2067
Loss = 1.6264e-02, PNorm = 421.7268, GNorm = 0.0300, lr_0 = 9.9890e-04
Validation auc = 0.723973
Epoch 2068
Loss = 1.9867e-02, PNorm = 421.7792, GNorm = 1.1986, lr_0 = 9.9889e-04
Validation auc = 0.713350
Epoch 2069
Loss = 4.0199e-02, PNorm = 421.8402, GNorm = 1.6665, lr_0 = 9.9889e-04
Loss = 7.9442e-02, PNorm = 421.9344, GNorm = 0.1834, lr_0 = 9.9889e-04
Validation auc = 0.710883
Epoch 2070
Loss = 5.4611e-02, PNorm = 422.0429, GNorm = 0.6060, lr_0 = 9.9889e-04
Validation auc = 0.700990
Epoch 2071
Loss = 3.3857e-02, PNorm = 422.1289, GNorm = 0.7541, lr_0 = 9.9889e-04
Validation auc = 0.713139
Epoch 2072
Loss = 4.9810e-02, PNorm = 422.2089, GNorm = 3.8156, lr_0 = 9.9889e-04
Validation auc = 0.725279
Epoch 2073
Loss = 4.2068e-02, PNorm = 422.3167, GNorm = 0.5890, lr_0 = 9.9889e-04
Validation auc = 0.731008
Epoch 2074
Loss = 3.1845e-02, PNorm = 422.4237, GNorm = 0.3771, lr_0 = 9.9889e-04
Validation auc = 0.736479
Epoch 2075
Loss = 3.6654e-02, PNorm = 422.5154, GNorm = 0.2879, lr_0 = 9.9889e-04
Validation auc = 0.738206
Epoch 2076
Loss = 6.3475e-02, PNorm = 422.6185, GNorm = 2.6908, lr_0 = 9.9889e-04
Validation auc = 0.724815
Epoch 2077
Loss = 1.9290e-02, PNorm = 422.7380, GNorm = 1.9282, lr_0 = 9.9889e-04
Validation auc = 0.707332
Epoch 2078
Loss = 6.9073e-02, PNorm = 422.8549, GNorm = 2.3132, lr_0 = 9.9889e-04
Validation auc = 0.709991
Epoch 2079
Loss = 1.0014e-02, PNorm = 422.9994, GNorm = 0.3634, lr_0 = 9.9889e-04
Loss = 8.5822e-02, PNorm = 423.1420, GNorm = 2.4639, lr_0 = 9.9889e-04
Validation auc = 0.712643
Epoch 2080
Loss = 9.0211e-02, PNorm = 423.3624, GNorm = 2.3686, lr_0 = 9.9889e-04
Validation auc = 0.685221
Epoch 2081
Loss = 2.7684e-01, PNorm = 423.6015, GNorm = 0.3590, lr_0 = 9.9888e-04
Validation auc = 0.661216
Epoch 2082
Loss = 7.6405e-02, PNorm = 423.8495, GNorm = 0.6245, lr_0 = 9.9888e-04
Validation auc = 0.673297
Epoch 2083
Loss = 5.4941e-02, PNorm = 424.0133, GNorm = 0.2715, lr_0 = 9.9888e-04
Validation auc = 0.678909
Epoch 2084
Loss = 3.9186e-02, PNorm = 424.1355, GNorm = 1.0058, lr_0 = 9.9888e-04
Validation auc = 0.684920
Epoch 2085
Loss = 3.5761e-02, PNorm = 424.2305, GNorm = 1.1725, lr_0 = 9.9888e-04
Validation auc = 0.690814
Epoch 2086
Loss = 4.4526e-02, PNorm = 424.3243, GNorm = 2.3115, lr_0 = 9.9888e-04
Validation auc = 0.700669
Epoch 2087
Loss = 4.4328e-02, PNorm = 424.4157, GNorm = 2.2222, lr_0 = 9.9888e-04
Validation auc = 0.722840
Epoch 2088
Loss = 1.8818e-01, PNorm = 424.4887, GNorm = 3.4944, lr_0 = 9.9888e-04
Validation auc = 0.716321
Epoch 2089
Loss = 1.2320e-02, PNorm = 424.5668, GNorm = 1.2443, lr_0 = 9.9888e-04
Loss = 6.5822e-02, PNorm = 424.6674, GNorm = 0.0931, lr_0 = 9.9888e-04
Validation auc = 0.701028
Epoch 2090
Loss = 2.7182e-02, PNorm = 424.7460, GNorm = 0.3658, lr_0 = 9.9888e-04
Validation auc = 0.703732
Epoch 2091
Loss = 2.1826e-02, PNorm = 424.8195, GNorm = 1.4346, lr_0 = 9.9888e-04
Validation auc = 0.723053
Epoch 2092
Loss = 5.1762e-02, PNorm = 424.8898, GNorm = 0.3560, lr_0 = 9.9888e-04
Validation auc = 0.736392
Epoch 2093
Loss = 3.7457e-02, PNorm = 424.9706, GNorm = 3.9644, lr_0 = 9.9888e-04
Validation auc = 0.742903
Epoch 2094
Loss = 1.2767e-01, PNorm = 425.0486, GNorm = 6.2224, lr_0 = 9.9887e-04
Validation auc = 0.737086
Epoch 2095
Loss = 1.0683e-01, PNorm = 425.1393, GNorm = 0.3589, lr_0 = 9.9887e-04
Validation auc = 0.730337
Epoch 2096
Loss = 1.0999e-01, PNorm = 425.2661, GNorm = 0.5902, lr_0 = 9.9887e-04
Validation auc = 0.707874
Epoch 2097
Loss = 1.6210e-01, PNorm = 425.4062, GNorm = 0.9625, lr_0 = 9.9887e-04
Validation auc = 0.678480
Epoch 2098
Loss = 2.0699e-02, PNorm = 425.5413, GNorm = 0.9475, lr_0 = 9.9887e-04
Validation auc = 0.681692
Epoch 2099
Loss = 4.6181e-02, PNorm = 425.6330, GNorm = 2.3481, lr_0 = 9.9887e-04
Loss = 6.0712e-02, PNorm = 425.7202, GNorm = 2.0412, lr_0 = 9.9887e-04
Validation auc = 0.705512
Epoch 2100
Loss = 8.8378e-02, PNorm = 425.8251, GNorm = 0.5831, lr_0 = 9.9887e-04
Validation auc = 0.731321
Epoch 2101
Loss = 7.7259e-02, PNorm = 425.9757, GNorm = 2.2698, lr_0 = 9.9887e-04
Validation auc = 0.738825
Epoch 2102
Loss = 3.8831e-02, PNorm = 426.1143, GNorm = 0.9772, lr_0 = 9.9887e-04
Validation auc = 0.735522
Epoch 2103
Loss = 4.9992e-02, PNorm = 426.2230, GNorm = 3.1728, lr_0 = 9.9887e-04
Validation auc = 0.714980
Epoch 2104
Loss = 7.1269e-02, PNorm = 426.3332, GNorm = 5.9883, lr_0 = 9.9887e-04
Validation auc = 0.724270
Epoch 2105
Loss = 6.0976e-02, PNorm = 426.4481, GNorm = 0.0402, lr_0 = 9.9887e-04
Validation auc = 0.724208
Epoch 2106
Loss = 3.5143e-02, PNorm = 426.5438, GNorm = 0.7654, lr_0 = 9.9887e-04
Validation auc = 0.733611
Epoch 2107
Loss = 8.8121e-02, PNorm = 426.6170, GNorm = 5.8913, lr_0 = 9.9887e-04
Validation auc = 0.722836
Epoch 2108
Loss = 1.0594e-01, PNorm = 426.6886, GNorm = 7.5070, lr_0 = 9.9886e-04
Validation auc = 0.731381
Epoch 2109
Loss = 1.6292e-01, PNorm = 426.7681, GNorm = 2.7995, lr_0 = 9.9886e-04
Loss = 4.5720e-02, PNorm = 426.8472, GNorm = 0.9501, lr_0 = 9.9886e-04
Validation auc = 0.723736
Epoch 2110
Loss = 2.7726e-02, PNorm = 426.9240, GNorm = 0.4848, lr_0 = 9.9886e-04
Validation auc = 0.720011
Epoch 2111
Loss = 2.7540e-02, PNorm = 426.9900, GNorm = 0.4724, lr_0 = 9.9886e-04
Validation auc = 0.724335
Epoch 2112
Loss = 2.9419e-02, PNorm = 427.0440, GNorm = 0.3873, lr_0 = 9.9886e-04
Validation auc = 0.729359
Epoch 2113
Loss = 3.5997e-02, PNorm = 427.1298, GNorm = 0.0509, lr_0 = 9.9886e-04
Validation auc = 0.715074
Epoch 2114
Loss = 2.4951e-02, PNorm = 427.2230, GNorm = 0.7427, lr_0 = 9.9886e-04
Validation auc = 0.712753
Epoch 2115
Loss = 1.0887e-01, PNorm = 427.3168, GNorm = 0.8141, lr_0 = 9.9886e-04
Validation auc = 0.696663
Epoch 2116
Loss = 5.2287e-02, PNorm = 427.4451, GNorm = 4.9296, lr_0 = 9.9886e-04
Validation auc = 0.682889
Epoch 2117
Loss = 7.7112e-02, PNorm = 427.5710, GNorm = 4.6710, lr_0 = 9.9886e-04
Validation auc = 0.680761
Epoch 2118
Loss = 1.4369e-01, PNorm = 427.7230, GNorm = 3.9739, lr_0 = 9.9886e-04
Validation auc = 0.720491
Epoch 2119
Loss = 3.2384e-03, PNorm = 427.9302, GNorm = 0.1352, lr_0 = 9.9886e-04
Loss = 4.5253e-02, PNorm = 428.0841, GNorm = 0.4173, lr_0 = 9.9886e-04
Validation auc = 0.740886
Epoch 2120
Loss = 4.6032e-02, PNorm = 428.1999, GNorm = 3.5009, lr_0 = 9.9885e-04
Validation auc = 0.731030
Epoch 2121
Loss = 1.1243e-01, PNorm = 428.3594, GNorm = 0.3245, lr_0 = 9.9885e-04
Validation auc = 0.724874
Epoch 2122
Loss = 4.0902e-02, PNorm = 428.5285, GNorm = 1.1237, lr_0 = 9.9885e-04
Validation auc = 0.734524
Epoch 2123
Loss = 7.2340e-02, PNorm = 428.6522, GNorm = 0.1343, lr_0 = 9.9885e-04
Validation auc = 0.726131
Epoch 2124
Loss = 5.3696e-02, PNorm = 428.7591, GNorm = 1.8428, lr_0 = 9.9885e-04
Validation auc = 0.715259
Epoch 2125
Loss = 5.9520e-02, PNorm = 428.8424, GNorm = 1.1301, lr_0 = 9.9885e-04
Validation auc = 0.718131
Epoch 2126
Loss = 3.7374e-02, PNorm = 428.9351, GNorm = 0.3232, lr_0 = 9.9885e-04
Validation auc = 0.725492
Epoch 2127
Loss = 2.3077e-02, PNorm = 429.0269, GNorm = 0.0658, lr_0 = 9.9885e-04
Validation auc = 0.721163
Epoch 2128
Loss = 1.2683e-01, PNorm = 429.1172, GNorm = 0.2432, lr_0 = 9.9885e-04
Validation auc = 0.720320
Epoch 2129
Loss = 6.2789e-03, PNorm = 429.2080, GNorm = 0.3342, lr_0 = 9.9885e-04
Loss = 2.7054e-02, PNorm = 429.2788, GNorm = 0.5036, lr_0 = 9.9885e-04
Validation auc = 0.724621
Epoch 2130
Loss = 4.4582e-02, PNorm = 429.3447, GNorm = 0.4416, lr_0 = 9.9885e-04
Validation auc = 0.723001
Epoch 2131
Loss = 3.9748e-02, PNorm = 429.4158, GNorm = 0.0310, lr_0 = 9.9885e-04
Validation auc = 0.725238
Epoch 2132
Loss = 8.0950e-02, PNorm = 429.4865, GNorm = 5.9158, lr_0 = 9.9885e-04
Validation auc = 0.707120
Epoch 2133
Loss = 4.5618e-02, PNorm = 429.5983, GNorm = 0.1671, lr_0 = 9.9885e-04
Validation auc = 0.699309
Epoch 2134
Loss = 5.0750e-02, PNorm = 429.7119, GNorm = 1.8681, lr_0 = 9.9884e-04
Validation auc = 0.717563
Epoch 2135
Loss = 3.7944e-02, PNorm = 429.8094, GNorm = 0.4253, lr_0 = 9.9884e-04
Validation auc = 0.710584
Epoch 2136
Loss = 2.3759e-02, PNorm = 429.9023, GNorm = 0.2156, lr_0 = 9.9884e-04
Validation auc = 0.694901
Epoch 2137
Loss = 5.9715e-02, PNorm = 429.9969, GNorm = 3.8510, lr_0 = 9.9884e-04
Validation auc = 0.690124
Epoch 2138
Loss = 8.4208e-02, PNorm = 430.1103, GNorm = 1.0809, lr_0 = 9.9884e-04
Validation auc = 0.696356
Epoch 2139
Loss = 5.7931e-03, PNorm = 430.2343, GNorm = 0.2981, lr_0 = 9.9884e-04
Loss = 3.8107e-02, PNorm = 430.3568, GNorm = 1.4650, lr_0 = 9.9884e-04
Validation auc = 0.699429
Epoch 2140
Loss = 2.7489e-02, PNorm = 430.4625, GNorm = 0.5474, lr_0 = 9.9884e-04
Validation auc = 0.705760
Epoch 2141
Loss = 2.6054e-02, PNorm = 430.5520, GNorm = 0.0894, lr_0 = 9.9884e-04
Validation auc = 0.702687
Epoch 2142
Loss = 2.8402e-02, PNorm = 430.6503, GNorm = 1.3473, lr_0 = 9.9884e-04
Validation auc = 0.708702
Epoch 2143
Loss = 9.2095e-02, PNorm = 430.7296, GNorm = 0.0744, lr_0 = 9.9884e-04
Validation auc = 0.713297
Epoch 2144
Loss = 3.8607e-02, PNorm = 430.8295, GNorm = 0.2407, lr_0 = 9.9884e-04
Validation auc = 0.715758
Epoch 2145
Loss = 7.2068e-02, PNorm = 430.9371, GNorm = 3.5677, lr_0 = 9.9884e-04
Validation auc = 0.715467
Epoch 2146
Loss = 1.4613e-01, PNorm = 431.0406, GNorm = 0.9246, lr_0 = 9.9884e-04
Validation auc = 0.716141
Epoch 2147
Loss = 6.0781e-02, PNorm = 431.1513, GNorm = 0.9789, lr_0 = 9.9883e-04
Validation auc = 0.712761
Epoch 2148
Loss = 1.5033e-02, PNorm = 431.2373, GNorm = 1.1240, lr_0 = 9.9883e-04
Validation auc = 0.715640
Epoch 2149
Loss = 9.7042e-02, PNorm = 431.2978, GNorm = 2.4104, lr_0 = 9.9883e-04
Loss = 3.4509e-02, PNorm = 431.3612, GNorm = 0.8920, lr_0 = 9.9883e-04
Validation auc = 0.708952
Epoch 2150
Loss = 5.0651e-02, PNorm = 431.4241, GNorm = 0.5355, lr_0 = 9.9883e-04
Validation auc = 0.722586
Epoch 2151
Loss = 6.4942e-02, PNorm = 431.5160, GNorm = 2.1381, lr_0 = 9.9883e-04
Validation auc = 0.735972
Epoch 2152
Loss = 7.7570e-02, PNorm = 431.6089, GNorm = 8.0669, lr_0 = 9.9883e-04
Validation auc = 0.736385
Epoch 2153
Loss = 2.6328e-02, PNorm = 431.7036, GNorm = 0.5053, lr_0 = 9.9883e-04
Validation auc = 0.737213
Epoch 2154
Loss = 2.1141e-02, PNorm = 431.7815, GNorm = 0.4582, lr_0 = 9.9883e-04
Validation auc = 0.731040
Epoch 2155
Loss = 1.8773e-02, PNorm = 431.8548, GNorm = 0.1269, lr_0 = 9.9883e-04
Validation auc = 0.728773
Epoch 2156
Loss = 3.5763e-02, PNorm = 431.9305, GNorm = 1.4189, lr_0 = 9.9883e-04
Validation auc = 0.728136
Epoch 2157
Loss = 6.9022e-02, PNorm = 432.0011, GNorm = 3.1391, lr_0 = 9.9883e-04
Validation auc = 0.717390
Epoch 2158
Loss = 9.5156e-02, PNorm = 432.0657, GNorm = 0.2589, lr_0 = 9.9883e-04
Validation auc = 0.703905
Epoch 2159
Loss = 1.1517e-02, PNorm = 432.1357, GNorm = 0.2621, lr_0 = 9.9883e-04
Loss = 4.2774e-02, PNorm = 432.2060, GNorm = 4.4462, lr_0 = 9.9883e-04
Validation auc = 0.693684
Epoch 2160
Loss = 6.6046e-02, PNorm = 432.2992, GNorm = 0.4568, lr_0 = 9.9882e-04
Validation auc = 0.687974
Epoch 2161
Loss = 5.4400e-02, PNorm = 432.4098, GNorm = 0.3434, lr_0 = 9.9882e-04
Validation auc = 0.713079
Epoch 2162
Loss = 7.1460e-02, PNorm = 432.5262, GNorm = 0.7244, lr_0 = 9.9882e-04
Validation auc = 0.714225
Epoch 2163
Loss = 4.1578e-02, PNorm = 432.6749, GNorm = 1.2710, lr_0 = 9.9882e-04
Validation auc = 0.729048
Epoch 2164
Loss = 8.9097e-02, PNorm = 432.8034, GNorm = 4.9422, lr_0 = 9.9882e-04
Validation auc = 0.714472
Epoch 2165
Loss = 2.8281e-02, PNorm = 432.9415, GNorm = 2.0197, lr_0 = 9.9882e-04
Validation auc = 0.715583
Epoch 2166
Loss = 2.1104e-02, PNorm = 433.0777, GNorm = 0.7230, lr_0 = 9.9882e-04
Validation auc = 0.707962
Epoch 2167
Loss = 3.4800e-02, PNorm = 433.1848, GNorm = 0.3528, lr_0 = 9.9882e-04
Validation auc = 0.685304
Epoch 2168
Loss = 1.8601e-02, PNorm = 433.2824, GNorm = 0.7701, lr_0 = 9.9882e-04
Validation auc = 0.685029
Epoch 2169
Loss = 3.1040e-02, PNorm = 433.3738, GNorm = 2.2324, lr_0 = 9.9882e-04
Loss = 2.0438e-02, PNorm = 433.4553, GNorm = 0.1128, lr_0 = 9.9882e-04
Validation auc = 0.680778
Epoch 2170
Loss = 2.6300e-02, PNorm = 433.5241, GNorm = 3.3558, lr_0 = 9.9882e-04
Validation auc = 0.683147
Epoch 2171
Loss = 5.0008e-02, PNorm = 433.5910, GNorm = 1.1133, lr_0 = 9.9882e-04
Validation auc = 0.693630
Epoch 2172
Loss = 2.1086e-02, PNorm = 433.6534, GNorm = 2.2564, lr_0 = 9.9882e-04
Validation auc = 0.695767
Epoch 2173
Loss = 2.7360e-02, PNorm = 433.7093, GNorm = 0.0500, lr_0 = 9.9882e-04
Validation auc = 0.694889
Epoch 2174
Loss = 4.1531e-02, PNorm = 433.7850, GNorm = 3.8863, lr_0 = 9.9881e-04
Validation auc = 0.692964
Epoch 2175
Loss = 8.1640e-03, PNorm = 433.8650, GNorm = 0.7477, lr_0 = 9.9881e-04
Validation auc = 0.703253
Epoch 2176
Loss = 6.7946e-03, PNorm = 433.9446, GNorm = 0.1840, lr_0 = 9.9881e-04
Validation auc = 0.707979
Epoch 2177
Loss = 3.1249e-03, PNorm = 434.0115, GNorm = 0.1179, lr_0 = 9.9881e-04
Validation auc = 0.698475
Epoch 2178
Loss = 1.4165e-02, PNorm = 434.0631, GNorm = 1.3650, lr_0 = 9.9881e-04
Validation auc = 0.691923
Epoch 2179
Loss = 2.5640e-01, PNorm = 434.1359, GNorm = 4.2120, lr_0 = 9.9881e-04
Loss = 4.0312e-02, PNorm = 434.2486, GNorm = 0.8378, lr_0 = 9.9881e-04
Validation auc = 0.721173
Epoch 2180
Loss = 3.9575e-02, PNorm = 434.3446, GNorm = 1.0533, lr_0 = 9.9881e-04
Validation auc = 0.723292
Epoch 2181
Loss = 4.0958e-02, PNorm = 434.4650, GNorm = 0.3030, lr_0 = 9.9881e-04
Validation auc = 0.700952
Epoch 2182
Loss = 2.8424e-02, PNorm = 434.5662, GNorm = 0.2829, lr_0 = 9.9881e-04
Validation auc = 0.699152
Epoch 2183
Loss = 1.0164e-01, PNorm = 434.6411, GNorm = 0.3051, lr_0 = 9.9881e-04
Validation auc = 0.700255
Epoch 2184
Loss = 5.2352e-02, PNorm = 434.7475, GNorm = 1.1995, lr_0 = 9.9881e-04
Validation auc = 0.697901
Epoch 2185
Loss = 9.3474e-02, PNorm = 434.8616, GNorm = 1.5645, lr_0 = 9.9881e-04
Validation auc = 0.701166
Epoch 2186
Loss = 1.4580e-01, PNorm = 435.0089, GNorm = 4.6877, lr_0 = 9.9881e-04
Validation auc = 0.712929
Epoch 2187
Loss = 8.7942e-02, PNorm = 435.1870, GNorm = 0.5251, lr_0 = 9.9880e-04
Validation auc = 0.702845
Epoch 2188
Loss = 7.1673e-02, PNorm = 435.3722, GNorm = 2.6641, lr_0 = 9.9880e-04
Validation auc = 0.702742
Epoch 2189
Loss = 4.1959e-02, PNorm = 435.5551, GNorm = 0.9751, lr_0 = 9.9880e-04
Loss = 4.4472e-02, PNorm = 435.7162, GNorm = 0.4935, lr_0 = 9.9880e-04
Validation auc = 0.703384
Epoch 2190
Loss = 2.5277e-02, PNorm = 435.8304, GNorm = 0.1955, lr_0 = 9.9880e-04
Validation auc = 0.704035
Epoch 2191
Loss = 2.8229e-02, PNorm = 435.9014, GNorm = 0.2385, lr_0 = 9.9880e-04
Validation auc = 0.705549
Epoch 2192
Loss = 2.1709e-02, PNorm = 435.9664, GNorm = 0.2350, lr_0 = 9.9880e-04
Validation auc = 0.706896
Epoch 2193
Loss = 7.1169e-02, PNorm = 436.0400, GNorm = 0.6996, lr_0 = 9.9880e-04
Validation auc = 0.688734
Epoch 2194
Loss = 5.2066e-02, PNorm = 436.1455, GNorm = 0.1172, lr_0 = 9.9880e-04
Validation auc = 0.713252
Epoch 2195
Loss = 2.5987e-02, PNorm = 436.2476, GNorm = 0.8072, lr_0 = 9.9880e-04
Validation auc = 0.708278
Epoch 2196
Loss = 2.5897e-02, PNorm = 436.3135, GNorm = 0.9790, lr_0 = 9.9880e-04
Validation auc = 0.706478
Epoch 2197
Loss = 2.3157e-02, PNorm = 436.3833, GNorm = 2.7848, lr_0 = 9.9880e-04
Validation auc = 0.696079
Epoch 2198
Loss = 3.9567e-03, PNorm = 436.4609, GNorm = 0.3135, lr_0 = 9.9880e-04
Validation auc = 0.685754
Epoch 2199
Loss = 2.7706e-02, PNorm = 436.5315, GNorm = 0.7232, lr_0 = 9.9880e-04
Loss = 4.0849e-02, PNorm = 436.6056, GNorm = 1.6120, lr_0 = 9.9880e-04
Validation auc = 0.681279
Epoch 2200
Loss = 1.3117e-02, PNorm = 436.6637, GNorm = 0.6166, lr_0 = 9.9879e-04
Validation auc = 0.680229
Epoch 2201
Loss = 5.2903e-02, PNorm = 436.7098, GNorm = 0.6823, lr_0 = 9.9879e-04
Validation auc = 0.689950
Epoch 2202
Loss = 1.4262e-02, PNorm = 436.7739, GNorm = 0.2198, lr_0 = 9.9879e-04
Validation auc = 0.699277
Epoch 2203
Loss = 3.2722e-02, PNorm = 436.8361, GNorm = 0.3052, lr_0 = 9.9879e-04
Validation auc = 0.708577
Epoch 2204
Loss = 7.7830e-02, PNorm = 436.9039, GNorm = 1.0544, lr_0 = 9.9879e-04
Validation auc = 0.705657
Epoch 2205
Loss = 7.5774e-03, PNorm = 436.9809, GNorm = 0.1940, lr_0 = 9.9879e-04
Validation auc = 0.699508
Epoch 2206
Loss = 1.6561e-02, PNorm = 437.0627, GNorm = 0.0470, lr_0 = 9.9879e-04
Validation auc = 0.693019
Epoch 2207
Loss = 8.6038e-02, PNorm = 437.1625, GNorm = 1.7047, lr_0 = 9.9879e-04
Validation auc = 0.698614
Epoch 2208
Loss = 1.3281e-02, PNorm = 437.2714, GNorm = 0.2912, lr_0 = 9.9879e-04
Validation auc = 0.705492
Epoch 2209
Loss = 1.2325e-02, PNorm = 437.3639, GNorm = 0.4776, lr_0 = 9.9879e-04
Loss = 4.1508e-02, PNorm = 437.4336, GNorm = 0.4424, lr_0 = 9.9879e-04
Validation auc = 0.714335
Epoch 2210
Loss = 4.2070e-02, PNorm = 437.5218, GNorm = 0.2213, lr_0 = 9.9879e-04
Validation auc = 0.723440
Epoch 2211
Loss = 4.0840e-02, PNorm = 437.6063, GNorm = 2.2060, lr_0 = 9.9879e-04
Validation auc = 0.718552
Epoch 2212
Loss = 1.3541e-01, PNorm = 437.6936, GNorm = 1.1454, lr_0 = 9.9879e-04
Validation auc = 0.719048
Epoch 2213
Loss = 4.8549e-02, PNorm = 437.7927, GNorm = 0.1550, lr_0 = 9.9878e-04
Validation auc = 0.722744
Epoch 2214
Loss = 1.7868e-02, PNorm = 437.8763, GNorm = 3.8663, lr_0 = 9.9878e-04
Validation auc = 0.724220
Epoch 2215
Loss = 3.4752e-02, PNorm = 437.9434, GNorm = 1.3483, lr_0 = 9.9878e-04
Validation auc = 0.717446
Epoch 2216
Loss = 1.2598e-01, PNorm = 438.0059, GNorm = 4.1236, lr_0 = 9.9878e-04
Validation auc = 0.718606
Epoch 2217
Loss = 9.3863e-02, PNorm = 438.0856, GNorm = 3.6587, lr_0 = 9.9878e-04
Validation auc = 0.703476
Epoch 2218
Loss = 1.6309e-02, PNorm = 438.1726, GNorm = 0.8839, lr_0 = 9.9878e-04
Validation auc = 0.699651
Epoch 2219
Loss = 7.2137e-04, PNorm = 438.2366, GNorm = 0.0362, lr_0 = 9.9878e-04
Loss = 4.2186e-02, PNorm = 438.2840, GNorm = 0.1485, lr_0 = 9.9878e-04
Validation auc = 0.696482
Epoch 2220
Loss = 6.4767e-02, PNorm = 438.3683, GNorm = 2.7023, lr_0 = 9.9878e-04
Validation auc = 0.718512
Epoch 2221
Loss = 6.1431e-02, PNorm = 438.4842, GNorm = 1.8557, lr_0 = 9.9878e-04
Validation auc = 0.729139
Epoch 2222
Loss = 5.5466e-02, PNorm = 438.5850, GNorm = 1.3759, lr_0 = 9.9878e-04
Validation auc = 0.725412
Epoch 2223
Loss = 6.4799e-02, PNorm = 438.6600, GNorm = 0.4258, lr_0 = 9.9878e-04
Validation auc = 0.722011
Epoch 2224
Loss = 9.3666e-02, PNorm = 438.7307, GNorm = 4.6299, lr_0 = 9.9878e-04
Validation auc = 0.708320
Epoch 2225
Loss = 4.2788e-02, PNorm = 438.8228, GNorm = 3.0113, lr_0 = 9.9878e-04
Validation auc = 0.705868
Epoch 2226
Loss = 2.1939e-02, PNorm = 438.9089, GNorm = 1.6564, lr_0 = 9.9878e-04
Validation auc = 0.704957
Epoch 2227
Loss = 6.0045e-02, PNorm = 438.9816, GNorm = 2.2014, lr_0 = 9.9877e-04
Validation auc = 0.711957
Epoch 2228
Loss = 5.0188e-02, PNorm = 439.0726, GNorm = 0.9938, lr_0 = 9.9877e-04
Validation auc = 0.715199
Epoch 2229
Loss = 2.0065e-02, PNorm = 439.1650, GNorm = 0.6278, lr_0 = 9.9877e-04
Loss = 6.3864e-02, PNorm = 439.2436, GNorm = 0.1674, lr_0 = 9.9877e-04
Validation auc = 0.718839
Epoch 2230
Loss = 5.6259e-02, PNorm = 439.3312, GNorm = 0.1627, lr_0 = 9.9877e-04
Validation auc = 0.725453
Epoch 2231
Loss = 6.5827e-02, PNorm = 439.4063, GNorm = 4.2002, lr_0 = 9.9877e-04
Validation auc = 0.718924
Epoch 2232
Loss = 1.3159e-02, PNorm = 439.4745, GNorm = 0.1101, lr_0 = 9.9877e-04
Validation auc = 0.717600
Epoch 2233
Loss = 1.3870e-02, PNorm = 439.5281, GNorm = 0.9219, lr_0 = 9.9877e-04
Validation auc = 0.714750
Epoch 2234
Loss = 3.2531e-02, PNorm = 439.5841, GNorm = 1.1128, lr_0 = 9.9877e-04
Validation auc = 0.710552
Epoch 2235
Loss = 2.0977e-02, PNorm = 439.6455, GNorm = 2.5354, lr_0 = 9.9877e-04
Validation auc = 0.712051
Epoch 2236
Loss = 9.8965e-03, PNorm = 439.7130, GNorm = 1.0997, lr_0 = 9.9877e-04
Validation auc = 0.713858
Epoch 2237
Loss = 2.9546e-03, PNorm = 439.7847, GNorm = 0.0204, lr_0 = 9.9877e-04
Validation auc = 0.709001
Epoch 2238
Loss = 8.2678e-03, PNorm = 439.8654, GNorm = 0.0460, lr_0 = 9.9877e-04
Validation auc = 0.713459
Epoch 2239
Loss = 5.3127e-03, PNorm = 439.9796, GNorm = 0.5872, lr_0 = 9.9877e-04
Loss = 5.1925e-02, PNorm = 440.0946, GNorm = 1.5440, lr_0 = 9.9876e-04
Validation auc = 0.722419
Epoch 2240
Loss = 5.5934e-02, PNorm = 440.2019, GNorm = 0.8121, lr_0 = 9.9876e-04
Validation auc = 0.716623
Epoch 2241
Loss = 3.4377e-02, PNorm = 440.3001, GNorm = 1.1683, lr_0 = 9.9876e-04
Validation auc = 0.724794
Epoch 2242
Loss = 1.8583e-02, PNorm = 440.3863, GNorm = 0.0800, lr_0 = 9.9876e-04
Validation auc = 0.724296
Epoch 2243
Loss = 2.5031e-02, PNorm = 440.4571, GNorm = 0.1460, lr_0 = 9.9876e-04
Validation auc = 0.723392
Epoch 2244
Loss = 3.5085e-02, PNorm = 440.5373, GNorm = 0.0996, lr_0 = 9.9876e-04
Validation auc = 0.722765
Epoch 2245
Loss = 7.1022e-03, PNorm = 440.6396, GNorm = 0.1076, lr_0 = 9.9876e-04
Validation auc = 0.714486
Epoch 2246
Loss = 2.7502e-02, PNorm = 440.7174, GNorm = 2.6297, lr_0 = 9.9876e-04
Validation auc = 0.695852
Epoch 2247
Loss = 1.1251e-01, PNorm = 440.8027, GNorm = 0.0727, lr_0 = 9.9876e-04
Validation auc = 0.689646
Epoch 2248
Loss = 1.6750e-02, PNorm = 440.9094, GNorm = 0.7552, lr_0 = 9.9876e-04
Validation auc = 0.692389
Epoch 2249
Loss = 1.7264e-02, PNorm = 441.0004, GNorm = 0.6394, lr_0 = 9.9876e-04
Loss = 3.2611e-02, PNorm = 441.0758, GNorm = 1.2689, lr_0 = 9.9876e-04
Validation auc = 0.704407
Epoch 2250
Loss = 9.7956e-03, PNorm = 441.1318, GNorm = 0.8189, lr_0 = 9.9876e-04
Validation auc = 0.712900
Epoch 2251
Loss = 2.9273e-02, PNorm = 441.1724, GNorm = 0.5574, lr_0 = 9.9876e-04
Validation auc = 0.714482
Epoch 2252
Loss = 1.5055e-02, PNorm = 441.2333, GNorm = 2.2124, lr_0 = 9.9876e-04
Validation auc = 0.710548
Epoch 2253
Loss = 5.1581e-02, PNorm = 441.2999, GNorm = 0.0069, lr_0 = 9.9875e-04
Validation auc = 0.706623
Epoch 2254
Loss = 5.0695e-02, PNorm = 441.3693, GNorm = 0.0356, lr_0 = 9.9875e-04
Validation auc = 0.718639
Epoch 2255
Loss = 2.9560e-02, PNorm = 441.4518, GNorm = 1.6198, lr_0 = 9.9875e-04
Validation auc = 0.712558
Epoch 2256
Loss = 1.0864e-02, PNorm = 441.5349, GNorm = 0.5648, lr_0 = 9.9875e-04
Validation auc = 0.704029
Epoch 2257
Loss = 8.0355e-02, PNorm = 441.6365, GNorm = 2.6118, lr_0 = 9.9875e-04
Validation auc = 0.709961
Epoch 2258
Loss = 6.9633e-02, PNorm = 441.7843, GNorm = 1.7831, lr_0 = 9.9875e-04
Validation auc = 0.725807
Epoch 2259
Loss = 4.9996e-02, PNorm = 441.9226, GNorm = 1.2698, lr_0 = 9.9875e-04
Loss = 3.6788e-02, PNorm = 442.0137, GNorm = 1.6319, lr_0 = 9.9875e-04
Validation auc = 0.728280
Epoch 2260
Loss = 4.6992e-02, PNorm = 442.0845, GNorm = 0.1085, lr_0 = 9.9875e-04
Validation auc = 0.738332
Epoch 2261
Loss = 9.8880e-02, PNorm = 442.1817, GNorm = 8.5871, lr_0 = 9.9875e-04
Validation auc = 0.746084
Epoch 2262
Loss = 5.9256e-02, PNorm = 442.3007, GNorm = 2.7502, lr_0 = 9.9875e-04
Validation auc = 0.743862
Epoch 2263
Loss = 3.3812e-02, PNorm = 442.4123, GNorm = 0.6718, lr_0 = 9.9875e-04
Validation auc = 0.738034
Epoch 2264
Loss = 4.5424e-02, PNorm = 442.5051, GNorm = 1.5706, lr_0 = 9.9875e-04
Validation auc = 0.737181
Epoch 2265
Loss = 5.8578e-02, PNorm = 442.5813, GNorm = 4.4336, lr_0 = 9.9875e-04
Validation auc = 0.722688
Epoch 2266
Loss = 7.3355e-02, PNorm = 442.6634, GNorm = 0.8602, lr_0 = 9.9874e-04
Validation auc = 0.714294
Epoch 2267
Loss = 8.6365e-02, PNorm = 442.7416, GNorm = 1.1788, lr_0 = 9.9874e-04
Validation auc = 0.717244
Epoch 2268
Loss = 1.1227e-02, PNorm = 442.8239, GNorm = 0.2355, lr_0 = 9.9874e-04
Validation auc = 0.725602
Epoch 2269
Loss = 1.5106e-02, PNorm = 442.8935, GNorm = 0.5499, lr_0 = 9.9874e-04
Loss = 6.6068e-02, PNorm = 442.9537, GNorm = 1.9902, lr_0 = 9.9874e-04
Validation auc = 0.724852
Epoch 2270
Loss = 6.1088e-02, PNorm = 443.0304, GNorm = 2.9708, lr_0 = 9.9874e-04
Validation auc = 0.725096
Epoch 2271
Loss = 2.3019e-02, PNorm = 443.1192, GNorm = 1.4936, lr_0 = 9.9874e-04
Validation auc = 0.720488
Epoch 2272
Loss = 3.4877e-02, PNorm = 443.1968, GNorm = 0.5060, lr_0 = 9.9874e-04
Validation auc = 0.718207
Epoch 2273
Loss = 6.5499e-02, PNorm = 443.2670, GNorm = 7.4241, lr_0 = 9.9874e-04
Validation auc = 0.723569
Epoch 2274
Loss = 6.8091e-02, PNorm = 443.3577, GNorm = 0.7649, lr_0 = 9.9874e-04
Validation auc = 0.720115
Epoch 2275
Loss = 5.2322e-02, PNorm = 443.4460, GNorm = 0.5129, lr_0 = 9.9874e-04
Validation auc = 0.717042
Epoch 2276
Loss = 2.5951e-02, PNorm = 443.5306, GNorm = 2.4954, lr_0 = 9.9874e-04
Validation auc = 0.714724
Epoch 2277
Loss = 2.7591e-02, PNorm = 443.6050, GNorm = 1.5089, lr_0 = 9.9874e-04
Validation auc = 0.713755
Epoch 2278
Loss = 3.4383e-02, PNorm = 443.6809, GNorm = 0.5715, lr_0 = 9.9874e-04
Validation auc = 0.706452
Epoch 2279
Loss = 2.0253e-03, PNorm = 443.7620, GNorm = 0.1423, lr_0 = 9.9874e-04
Loss = 4.4372e-02, PNorm = 443.8438, GNorm = 2.4284, lr_0 = 9.9873e-04
Validation auc = 0.711956
Epoch 2280
Loss = 1.6721e-02, PNorm = 443.9200, GNorm = 0.3361, lr_0 = 9.9873e-04
Validation auc = 0.711262
Epoch 2281
Loss = 5.3038e-02, PNorm = 443.9898, GNorm = 3.3594, lr_0 = 9.9873e-04
Validation auc = 0.720951
Epoch 2282
Loss = 7.9197e-02, PNorm = 444.0875, GNorm = 4.5130, lr_0 = 9.9873e-04
Validation auc = 0.734493
Epoch 2283
Loss = 4.4938e-02, PNorm = 444.1929, GNorm = 2.5982, lr_0 = 9.9873e-04
Validation auc = 0.726289
Epoch 2284
Loss = 5.3588e-02, PNorm = 444.3003, GNorm = 0.3169, lr_0 = 9.9873e-04
Validation auc = 0.716706
Epoch 2285
Loss = 5.8035e-02, PNorm = 444.4247, GNorm = 4.2734, lr_0 = 9.9873e-04
Validation auc = 0.725194
Epoch 2286
Loss = 1.7640e-02, PNorm = 444.5503, GNorm = 1.4457, lr_0 = 9.9873e-04
Validation auc = 0.736542
Epoch 2287
Loss = 1.3985e-02, PNorm = 444.6507, GNorm = 1.3376, lr_0 = 9.9873e-04
Validation auc = 0.740971
Epoch 2288
Loss = 8.7651e-02, PNorm = 444.7330, GNorm = 2.1300, lr_0 = 9.9873e-04
Validation auc = 0.742942
Epoch 2289
Loss = 4.4281e-02, PNorm = 444.8452, GNorm = 1.3895, lr_0 = 9.9873e-04
Loss = 5.0752e-02, PNorm = 444.9455, GNorm = 1.1042, lr_0 = 9.9873e-04
Validation auc = 0.740202
Epoch 2290
Loss = 6.2131e-02, PNorm = 445.0637, GNorm = 2.5232, lr_0 = 9.9873e-04
Validation auc = 0.738396
Epoch 2291
Loss = 5.4171e-02, PNorm = 445.1782, GNorm = 4.7374, lr_0 = 9.9873e-04
Validation auc = 0.732172
Epoch 2292
Loss = 5.6700e-02, PNorm = 445.2730, GNorm = 2.5757, lr_0 = 9.9872e-04
Validation auc = 0.724044
Epoch 2293
Loss = 6.4992e-02, PNorm = 445.3540, GNorm = 5.6185, lr_0 = 9.9872e-04
Validation auc = 0.718449
Epoch 2294
Loss = 6.3365e-02, PNorm = 445.4535, GNorm = 2.4176, lr_0 = 9.9872e-04
Validation auc = 0.722955
Epoch 2295
Loss = 1.8495e-02, PNorm = 445.5367, GNorm = 1.7179, lr_0 = 9.9872e-04
Validation auc = 0.720776
Epoch 2296
Loss = 6.3496e-02, PNorm = 445.6106, GNorm = 1.6150, lr_0 = 9.9872e-04
Validation auc = 0.714117
Epoch 2297
Loss = 2.6794e-02, PNorm = 445.7047, GNorm = 1.3875, lr_0 = 9.9872e-04
Validation auc = 0.720961
Epoch 2298
Loss = 2.7486e-02, PNorm = 445.8039, GNorm = 0.0392, lr_0 = 9.9872e-04
Validation auc = 0.717596
Epoch 2299
Loss = 1.7241e-01, PNorm = 445.9279, GNorm = 2.7582, lr_0 = 9.9872e-04
Loss = 1.1493e-01, PNorm = 446.0784, GNorm = 0.8124, lr_0 = 9.9872e-04
Validation auc = 0.717020
Epoch 2300
Loss = 8.4512e-02, PNorm = 446.2090, GNorm = 0.8018, lr_0 = 9.9872e-04
Validation auc = 0.717347
Epoch 2301
Loss = 4.8780e-02, PNorm = 446.3174, GNorm = 0.9032, lr_0 = 9.9872e-04
Validation auc = 0.720569
Epoch 2302
Loss = 4.9312e-02, PNorm = 446.4036, GNorm = 3.4245, lr_0 = 9.9872e-04
Validation auc = 0.728539
Epoch 2303
Loss = 6.1409e-02, PNorm = 446.4860, GNorm = 0.9660, lr_0 = 9.9872e-04
Validation auc = 0.718361
Epoch 2304
Loss = 4.8706e-02, PNorm = 446.5897, GNorm = 0.7424, lr_0 = 9.9872e-04
Validation auc = 0.722249
Epoch 2305
Loss = 7.0559e-02, PNorm = 446.6851, GNorm = 1.7953, lr_0 = 9.9872e-04
Validation auc = 0.727763
Epoch 2306
Loss = 9.6899e-03, PNorm = 446.7744, GNorm = 0.1012, lr_0 = 9.9871e-04
Validation auc = 0.726539
Epoch 2307
Loss = 5.4998e-02, PNorm = 446.8557, GNorm = 2.8263, lr_0 = 9.9871e-04
Validation auc = 0.710666
Epoch 2308
Loss = 4.4062e-02, PNorm = 446.9503, GNorm = 1.3363, lr_0 = 9.9871e-04
Validation auc = 0.697686
Epoch 2309
Loss = 9.1980e-03, PNorm = 447.0319, GNorm = 0.4096, lr_0 = 9.9871e-04
Loss = 5.4403e-02, PNorm = 447.1274, GNorm = 2.7334, lr_0 = 9.9871e-04
Validation auc = 0.704252
Epoch 2310
Loss = 4.8805e-02, PNorm = 447.2383, GNorm = 3.0413, lr_0 = 9.9871e-04
Validation auc = 0.681755
Epoch 2311
Loss = 5.5059e-02, PNorm = 447.3557, GNorm = 0.9460, lr_0 = 9.9871e-04
Validation auc = 0.692113
Epoch 2312
Loss = 2.5439e-02, PNorm = 447.4549, GNorm = 0.3296, lr_0 = 9.9871e-04
Validation auc = 0.704307
Epoch 2313
Loss = 3.3550e-02, PNorm = 447.5281, GNorm = 0.3770, lr_0 = 9.9871e-04
Validation auc = 0.698667
Epoch 2314
Loss = 1.1859e-01, PNorm = 447.6237, GNorm = 4.2742, lr_0 = 9.9871e-04
Validation auc = 0.686912
Epoch 2315
Loss = 3.9359e-02, PNorm = 447.7346, GNorm = 0.3392, lr_0 = 9.9871e-04
Validation auc = 0.705435
Epoch 2316
Loss = 1.5112e-02, PNorm = 447.8439, GNorm = 0.3427, lr_0 = 9.9871e-04
Validation auc = 0.735240
Epoch 2317
Loss = 5.4119e-03, PNorm = 447.9629, GNorm = 0.0904, lr_0 = 9.9871e-04
Validation auc = 0.736480
Epoch 2318
Loss = 2.2842e-02, PNorm = 448.0628, GNorm = 0.5447, lr_0 = 9.9871e-04
Validation auc = 0.728763
Epoch 2319
Loss = 9.0166e-03, PNorm = 448.1896, GNorm = 0.8649, lr_0 = 9.9871e-04
Loss = 7.9703e-02, PNorm = 448.3044, GNorm = 1.3765, lr_0 = 9.9870e-04
Validation auc = 0.712503
Epoch 2320
Loss = 9.4198e-02, PNorm = 448.4194, GNorm = 1.8731, lr_0 = 9.9870e-04
Validation auc = 0.710431
Epoch 2321
Loss = 7.2454e-02, PNorm = 448.5551, GNorm = 1.1957, lr_0 = 9.9870e-04
Validation auc = 0.697866
Epoch 2322
Loss = 8.2166e-02, PNorm = 448.6803, GNorm = 2.1697, lr_0 = 9.9870e-04
Validation auc = 0.710226
Epoch 2323
Loss = 5.2699e-02, PNorm = 448.7930, GNorm = 1.3998, lr_0 = 9.9870e-04
Validation auc = 0.714517
Epoch 2324
Loss = 3.1431e-02, PNorm = 448.8949, GNorm = 0.5970, lr_0 = 9.9870e-04
Validation auc = 0.714587
Epoch 2325
Loss = 2.1656e-02, PNorm = 448.9800, GNorm = 2.0820, lr_0 = 9.9870e-04
Validation auc = 0.720571
Epoch 2326
Loss = 2.4049e-02, PNorm = 449.0613, GNorm = 0.2997, lr_0 = 9.9870e-04
Validation auc = 0.728122
Epoch 2327
Loss = 1.3342e-01, PNorm = 449.1442, GNorm = 3.0189, lr_0 = 9.9870e-04
Validation auc = 0.724830
Epoch 2328
Loss = 5.7103e-02, PNorm = 449.2453, GNorm = 2.3393, lr_0 = 9.9870e-04
Validation auc = 0.716187
Epoch 2329
Loss = 1.1574e-02, PNorm = 449.3281, GNorm = 0.5402, lr_0 = 9.9870e-04
Loss = 1.5054e-02, PNorm = 449.3820, GNorm = 0.1706, lr_0 = 9.9870e-04
Validation auc = 0.726808
Epoch 2330
Loss = 3.8330e-02, PNorm = 449.4250, GNorm = 1.3030, lr_0 = 9.9870e-04
Validation auc = 0.734151
Epoch 2331
Loss = 8.0148e-02, PNorm = 449.4854, GNorm = 0.4777, lr_0 = 9.9870e-04
Validation auc = 0.733185
Epoch 2332
Loss = 5.3644e-02, PNorm = 449.5685, GNorm = 0.6351, lr_0 = 9.9869e-04
Validation auc = 0.727573
Epoch 2333
Loss = 3.9220e-02, PNorm = 449.6795, GNorm = 1.7205, lr_0 = 9.9869e-04
Validation auc = 0.723102
Epoch 2334
Loss = 1.1087e-01, PNorm = 449.7933, GNorm = 1.2059, lr_0 = 9.9869e-04
Validation auc = 0.713946
Epoch 2335
Loss = 5.4022e-02, PNorm = 449.9018, GNorm = 2.8130, lr_0 = 9.9869e-04
Validation auc = 0.711170
Epoch 2336
Loss = 7.0022e-02, PNorm = 450.0049, GNorm = 8.7905, lr_0 = 9.9869e-04
Validation auc = 0.719436
Epoch 2337
Loss = 1.2837e-02, PNorm = 450.1564, GNorm = 0.8540, lr_0 = 9.9869e-04
Validation auc = 0.717884
Epoch 2338
Loss = 1.7526e-02, PNorm = 450.2998, GNorm = 0.5055, lr_0 = 9.9869e-04
Validation auc = 0.729623
Epoch 2339
Loss = 1.2003e-02, PNorm = 450.4115, GNorm = 0.4592, lr_0 = 9.9869e-04
Loss = 2.1090e-02, PNorm = 450.4914, GNorm = 1.4664, lr_0 = 9.9869e-04
Validation auc = 0.739589
Epoch 2340
Loss = 6.7424e-02, PNorm = 450.5656, GNorm = 0.6345, lr_0 = 9.9869e-04
Validation auc = 0.719909
Epoch 2341
Loss = 5.9473e-02, PNorm = 450.6465, GNorm = 2.0471, lr_0 = 9.9869e-04
Validation auc = 0.718323
Epoch 2342
Loss = 4.0236e-02, PNorm = 450.7470, GNorm = 1.8362, lr_0 = 9.9869e-04
Validation auc = 0.722952
Epoch 2343
Loss = 4.4522e-02, PNorm = 450.8408, GNorm = 0.1112, lr_0 = 9.9869e-04
Validation auc = 0.716654
Epoch 2344
Loss = 4.0386e-02, PNorm = 450.9301, GNorm = 0.2147, lr_0 = 9.9869e-04
Validation auc = 0.710926
Epoch 2345
Loss = 4.6381e-02, PNorm = 451.0268, GNorm = 0.3559, lr_0 = 9.9869e-04
Validation auc = 0.723886
Epoch 2346
Loss = 2.0234e-02, PNorm = 451.1325, GNorm = 0.5796, lr_0 = 9.9868e-04
Validation auc = 0.712317
Epoch 2347
Loss = 1.7055e-02, PNorm = 451.2306, GNorm = 0.4635, lr_0 = 9.9868e-04
Validation auc = 0.699275
Epoch 2348
Loss = 2.3935e-01, PNorm = 451.3204, GNorm = 0.7483, lr_0 = 9.9868e-04
Validation auc = 0.693371
Epoch 2349
Loss = 1.7369e-02, PNorm = 451.4414, GNorm = 0.5714, lr_0 = 9.9868e-04
Loss = 4.7748e-02, PNorm = 451.5465, GNorm = 0.1426, lr_0 = 9.9868e-04
Validation auc = 0.694938
Epoch 2350
Loss = 4.5445e-02, PNorm = 451.6347, GNorm = 0.2733, lr_0 = 9.9868e-04
Validation auc = 0.695342
Epoch 2351
Loss = 2.5197e-02, PNorm = 451.7042, GNorm = 1.0446, lr_0 = 9.9868e-04
Validation auc = 0.698096
Epoch 2352
Loss = 2.4865e-02, PNorm = 451.7642, GNorm = 0.2196, lr_0 = 9.9868e-04
Validation auc = 0.694481
Epoch 2353
Loss = 5.1936e-02, PNorm = 451.8091, GNorm = 2.5772, lr_0 = 9.9868e-04
Validation auc = 0.709252
Epoch 2354
Loss = 7.3428e-02, PNorm = 451.8738, GNorm = 0.3504, lr_0 = 9.9868e-04
Validation auc = 0.714733
Epoch 2355
Loss = 5.5996e-02, PNorm = 451.9369, GNorm = 3.8189, lr_0 = 9.9868e-04
Validation auc = 0.712748
Epoch 2356
Loss = 1.0519e-02, PNorm = 452.0214, GNorm = 0.8197, lr_0 = 9.9868e-04
Validation auc = 0.718748
Epoch 2357
Loss = 1.9691e-02, PNorm = 452.0982, GNorm = 1.4565, lr_0 = 9.9868e-04
Validation auc = 0.721307
Epoch 2358
Loss = 3.3828e-02, PNorm = 452.1748, GNorm = 0.2391, lr_0 = 9.9868e-04
Validation auc = 0.718475
Epoch 2359
Loss = 7.6762e-03, PNorm = 452.2630, GNorm = 0.3829, lr_0 = 9.9867e-04
Loss = 3.9203e-02, PNorm = 452.3406, GNorm = 0.3074, lr_0 = 9.9867e-04
Validation auc = 0.720653
Epoch 2360
Loss = 3.0746e-02, PNorm = 452.4168, GNorm = 0.3759, lr_0 = 9.9867e-04
Validation auc = 0.719247
Epoch 2361
Loss = 2.2693e-02, PNorm = 452.4856, GNorm = 0.1912, lr_0 = 9.9867e-04
Validation auc = 0.710164
Epoch 2362
Loss = 4.2741e-02, PNorm = 452.5516, GNorm = 0.9416, lr_0 = 9.9867e-04
Validation auc = 0.700947
Epoch 2363
Loss = 2.0627e-02, PNorm = 452.6223, GNorm = 0.5822, lr_0 = 9.9867e-04
Validation auc = 0.700905
Epoch 2364
Loss = 2.7888e-01, PNorm = 452.7413, GNorm = 4.0916, lr_0 = 9.9867e-04
Validation auc = 0.688139
Epoch 2365
Loss = 5.8695e-02, PNorm = 452.9140, GNorm = 3.0330, lr_0 = 9.9867e-04
Validation auc = 0.680573
Epoch 2366
Loss = 1.2918e-01, PNorm = 453.0600, GNorm = 1.1873, lr_0 = 9.9867e-04
Validation auc = 0.691607
Epoch 2367
Loss = 3.9200e-02, PNorm = 453.1932, GNorm = 0.5257, lr_0 = 9.9867e-04
Validation auc = 0.693072
Epoch 2368
Loss = 1.1525e-02, PNorm = 453.3197, GNorm = 0.7581, lr_0 = 9.9867e-04
Validation auc = 0.697865
Epoch 2369
Loss = 3.2195e-02, PNorm = 453.4184, GNorm = 4.1537, lr_0 = 9.9867e-04
Loss = 2.8101e-02, PNorm = 453.5047, GNorm = 0.9080, lr_0 = 9.9867e-04
Validation auc = 0.716834
Epoch 2370
Loss = 3.8461e-02, PNorm = 453.5846, GNorm = 1.2376, lr_0 = 9.9867e-04
Validation auc = 0.720156
Epoch 2371
Loss = 3.1608e-02, PNorm = 453.6601, GNorm = 0.0913, lr_0 = 9.9867e-04
Validation auc = 0.711951
Epoch 2372
Loss = 4.0703e-02, PNorm = 453.7542, GNorm = 0.0996, lr_0 = 9.9866e-04
Validation auc = 0.721531
Epoch 2373
Loss = 2.2782e-02, PNorm = 453.8636, GNorm = 0.7325, lr_0 = 9.9866e-04
Validation auc = 0.729779
Epoch 2374
Loss = 1.1173e-01, PNorm = 453.9468, GNorm = 3.5644, lr_0 = 9.9866e-04
Validation auc = 0.731367
Epoch 2375
Loss = 4.8731e-02, PNorm = 454.0302, GNorm = 0.2515, lr_0 = 9.9866e-04
Validation auc = 0.715879
Epoch 2376
Loss = 6.8050e-02, PNorm = 454.1457, GNorm = 2.3139, lr_0 = 9.9866e-04
Validation auc = 0.702907
Epoch 2377
Loss = 5.1196e-02, PNorm = 454.2910, GNorm = 1.7635, lr_0 = 9.9866e-04
Validation auc = 0.714063
Epoch 2378
Loss = 6.7971e-02, PNorm = 454.4352, GNorm = 2.0263, lr_0 = 9.9866e-04
Validation auc = 0.715490
Epoch 2379
Loss = 4.4597e-02, PNorm = 454.5533, GNorm = 2.1951, lr_0 = 9.9866e-04
Loss = 6.7101e-02, PNorm = 454.6569, GNorm = 2.6122, lr_0 = 9.9866e-04
Validation auc = 0.716643
Epoch 2380
Loss = 5.0195e-02, PNorm = 454.7768, GNorm = 1.0801, lr_0 = 9.9866e-04
Validation auc = 0.722878
Epoch 2381
Loss = 3.4942e-02, PNorm = 454.8884, GNorm = 0.2530, lr_0 = 9.9866e-04
Validation auc = 0.724902
Epoch 2382
Loss = 5.0394e-02, PNorm = 454.9803, GNorm = 0.1344, lr_0 = 9.9866e-04
Validation auc = 0.734221
Epoch 2383
Loss = 6.7430e-02, PNorm = 455.0792, GNorm = 0.8010, lr_0 = 9.9866e-04
Validation auc = 0.742202
Epoch 2384
Loss = 8.2990e-02, PNorm = 455.1917, GNorm = 4.8727, lr_0 = 9.9866e-04
Validation auc = 0.741893
Epoch 2385
Loss = 8.9823e-02, PNorm = 455.2912, GNorm = 1.6216, lr_0 = 9.9865e-04
Validation auc = 0.738123
Epoch 2386
Loss = 2.2737e-02, PNorm = 455.3725, GNorm = 0.9504, lr_0 = 9.9865e-04
Validation auc = 0.745262
Epoch 2387
Loss = 3.0395e-02, PNorm = 455.4507, GNorm = 0.3169, lr_0 = 9.9865e-04
Validation auc = 0.734017
Epoch 2388
Loss = 3.4823e-02, PNorm = 455.5396, GNorm = 1.0808, lr_0 = 9.9865e-04
Validation auc = 0.715810
Epoch 2389
Loss = 1.6140e-01, PNorm = 455.6271, GNorm = 3.3800, lr_0 = 9.9865e-04
Loss = 4.0051e-02, PNorm = 455.7028, GNorm = 2.1934, lr_0 = 9.9865e-04
Validation auc = 0.713379
Epoch 2390
Loss = 2.0128e-02, PNorm = 455.7781, GNorm = 4.6815, lr_0 = 9.9865e-04
Validation auc = 0.719230
Epoch 2391
Loss = 5.6670e-03, PNorm = 455.8419, GNorm = 0.8751, lr_0 = 9.9865e-04
Validation auc = 0.723518
Epoch 2392
Loss = 5.0355e-02, PNorm = 455.8970, GNorm = 0.3008, lr_0 = 9.9865e-04
Validation auc = 0.718002
Epoch 2393
Loss = 6.9970e-02, PNorm = 455.9683, GNorm = 1.9587, lr_0 = 9.9865e-04
Validation auc = 0.713370
Epoch 2394
Loss = 2.4239e-02, PNorm = 456.0598, GNorm = 2.3287, lr_0 = 9.9865e-04
Validation auc = 0.706267
Epoch 2395
Loss = 6.3226e-02, PNorm = 456.1445, GNorm = 0.5177, lr_0 = 9.9865e-04
Validation auc = 0.714621
Epoch 2396
Loss = 4.7797e-02, PNorm = 456.2322, GNorm = 1.6020, lr_0 = 9.9865e-04
Validation auc = 0.715541
Epoch 2397
Loss = 2.7091e-02, PNorm = 456.3169, GNorm = 0.2241, lr_0 = 9.9865e-04
Validation auc = 0.710678
Epoch 2398
Loss = 1.9727e-02, PNorm = 456.3974, GNorm = 1.3143, lr_0 = 9.9865e-04
Validation auc = 0.719516
Epoch 2399
Loss = 2.0220e-02, PNorm = 456.4821, GNorm = 1.0882, lr_0 = 9.9864e-04
Loss = 5.5529e-02, PNorm = 456.5411, GNorm = 1.6548, lr_0 = 9.9864e-04
Validation auc = 0.712342
Epoch 2400
Loss = 5.9269e-02, PNorm = 456.6069, GNorm = 4.8508, lr_0 = 9.9864e-04
Validation auc = 0.727323
Epoch 2401
Loss = 4.5715e-02, PNorm = 456.6765, GNorm = 1.8622, lr_0 = 9.9864e-04
Validation auc = 0.734510
Epoch 2402
Loss = 1.9003e-02, PNorm = 456.7462, GNorm = 0.7872, lr_0 = 9.9864e-04
Validation auc = 0.732094
Epoch 2403
Loss = 4.8832e-02, PNorm = 456.7979, GNorm = 2.4272, lr_0 = 9.9864e-04
Validation auc = 0.724825
Epoch 2404
Loss = 5.5661e-02, PNorm = 456.8689, GNorm = 3.6981, lr_0 = 9.9864e-04
Validation auc = 0.724173
Epoch 2405
Loss = 4.1766e-02, PNorm = 456.9623, GNorm = 0.1355, lr_0 = 9.9864e-04
Validation auc = 0.721647
Epoch 2406
Loss = 6.7644e-02, PNorm = 457.0788, GNorm = 4.8840, lr_0 = 9.9864e-04
Validation auc = 0.729531
Epoch 2407
Loss = 8.3154e-02, PNorm = 457.2281, GNorm = 0.6178, lr_0 = 9.9864e-04
Validation auc = 0.743074
Epoch 2408
Loss = 3.5409e-02, PNorm = 457.3450, GNorm = 0.4241, lr_0 = 9.9864e-04
Validation auc = 0.747368
Epoch 2409
Loss = 1.5799e-02, PNorm = 457.4358, GNorm = 0.5935, lr_0 = 9.9864e-04
Loss = 7.5420e-02, PNorm = 457.5036, GNorm = 0.5577, lr_0 = 9.9864e-04
Validation auc = 0.754998
Epoch 2410
Loss = 7.3068e-02, PNorm = 457.5849, GNorm = 5.7763, lr_0 = 9.9864e-04
Validation auc = 0.726385
Epoch 2411
Loss = 6.4755e-02, PNorm = 457.6873, GNorm = 0.5108, lr_0 = 9.9863e-04
Validation auc = 0.707184
Epoch 2412
Loss = 3.4478e-02, PNorm = 457.7759, GNorm = 1.4784, lr_0 = 9.9863e-04
Validation auc = 0.700696
Epoch 2413
Loss = 5.1445e-02, PNorm = 457.8556, GNorm = 3.7643, lr_0 = 9.9863e-04
Validation auc = 0.696794
Epoch 2414
Loss = 1.7110e-02, PNorm = 457.9470, GNorm = 0.1362, lr_0 = 9.9863e-04
Validation auc = 0.699721
Epoch 2415
Loss = 4.3860e-02, PNorm = 458.0178, GNorm = 2.3091, lr_0 = 9.9863e-04
Validation auc = 0.702623
Epoch 2416
Loss = 7.6768e-02, PNorm = 458.1170, GNorm = 1.4216, lr_0 = 9.9863e-04
Validation auc = 0.703299
Epoch 2417
Loss = 7.5606e-02, PNorm = 458.2713, GNorm = 3.5653, lr_0 = 9.9863e-04
Validation auc = 0.714664
Epoch 2418
Loss = 3.2370e-02, PNorm = 458.4179, GNorm = 0.7672, lr_0 = 9.9863e-04
Validation auc = 0.715781
Epoch 2419
Loss = 7.7519e-03, PNorm = 458.5229, GNorm = 0.2904, lr_0 = 9.9863e-04
Loss = 4.1733e-02, PNorm = 458.6129, GNorm = 1.4760, lr_0 = 9.9863e-04
Validation auc = 0.720944
Epoch 2420
Loss = 9.7990e-02, PNorm = 458.7001, GNorm = 1.7455, lr_0 = 9.9863e-04
Validation auc = 0.709671
Epoch 2421
Loss = 6.8685e-02, PNorm = 458.8249, GNorm = 3.6612, lr_0 = 9.9863e-04
Validation auc = 0.708706
Epoch 2422
Loss = 4.2496e-02, PNorm = 458.9459, GNorm = 1.9237, lr_0 = 9.9863e-04
Validation auc = 0.716425
Epoch 2423
Loss = 2.9064e-02, PNorm = 459.0417, GNorm = 2.1330, lr_0 = 9.9863e-04
Validation auc = 0.718461
Epoch 2424
Loss = 1.2814e-02, PNorm = 459.1205, GNorm = 0.2708, lr_0 = 9.9863e-04
Validation auc = 0.715213
Epoch 2425
Loss = 8.4819e-02, PNorm = 459.1799, GNorm = 3.4123, lr_0 = 9.9862e-04
Validation auc = 0.710828
Epoch 2426
Loss = 5.9184e-02, PNorm = 459.2435, GNorm = 5.6648, lr_0 = 9.9862e-04
Validation auc = 0.709172
Epoch 2427
Loss = 2.4465e-02, PNorm = 459.3289, GNorm = 0.6843, lr_0 = 9.9862e-04
Validation auc = 0.701107
Epoch 2428
Loss = 9.5042e-02, PNorm = 459.4186, GNorm = 2.8008, lr_0 = 9.9862e-04
Validation auc = 0.694683
Epoch 2429
Loss = 1.8842e-03, PNorm = 459.5099, GNorm = 0.0725, lr_0 = 9.9862e-04
Loss = 1.9629e-02, PNorm = 459.5789, GNorm = 2.4050, lr_0 = 9.9862e-04
Validation auc = 0.698873
Epoch 2430
Loss = 8.6822e-02, PNorm = 459.6484, GNorm = 0.6210, lr_0 = 9.9862e-04
Validation auc = 0.696128
Epoch 2431
Loss = 4.3620e-02, PNorm = 459.7316, GNorm = 1.7383, lr_0 = 9.9862e-04
Validation auc = 0.699226
Epoch 2432
Loss = 4.5164e-02, PNorm = 459.8375, GNorm = 1.6810, lr_0 = 9.9862e-04
Validation auc = 0.700863
Epoch 2433
Loss = 5.3656e-02, PNorm = 459.9392, GNorm = 0.4972, lr_0 = 9.9862e-04
Validation auc = 0.697333
Epoch 2434
Loss = 1.3318e-02, PNorm = 460.0356, GNorm = 0.5366, lr_0 = 9.9862e-04
Validation auc = 0.701667
Epoch 2435
Loss = 4.3401e-02, PNorm = 460.1224, GNorm = 0.4947, lr_0 = 9.9862e-04
Validation auc = 0.704421
Epoch 2436
Loss = 5.2699e-02, PNorm = 460.1999, GNorm = 1.2465, lr_0 = 9.9862e-04
Validation auc = 0.708918
Epoch 2437
Loss = 1.8729e-01, PNorm = 460.2806, GNorm = 1.5623, lr_0 = 9.9862e-04
Validation auc = 0.720490
Epoch 2438
Loss = 2.1197e-02, PNorm = 460.4148, GNorm = 2.3683, lr_0 = 9.9861e-04
Validation auc = 0.718610
Epoch 2439
Loss = 1.3269e-02, PNorm = 460.5261, GNorm = 0.5360, lr_0 = 9.9861e-04
Loss = 2.0834e-01, PNorm = 460.6256, GNorm = 1.1527, lr_0 = 9.9861e-04
Validation auc = 0.703447
Epoch 2440
Loss = 4.8883e-02, PNorm = 460.7849, GNorm = 1.0243, lr_0 = 9.9861e-04
Validation auc = 0.689477
Epoch 2441
Loss = 5.6217e-02, PNorm = 460.9129, GNorm = 1.3780, lr_0 = 9.9861e-04
Validation auc = 0.700663
Epoch 2442
Loss = 6.6652e-02, PNorm = 461.0111, GNorm = 0.1169, lr_0 = 9.9861e-04
Validation auc = 0.707601
Epoch 2443
Loss = 4.3374e-02, PNorm = 461.1125, GNorm = 1.9075, lr_0 = 9.9861e-04
Validation auc = 0.702165
Epoch 2444
Loss = 4.3664e-02, PNorm = 461.2090, GNorm = 1.1313, lr_0 = 9.9861e-04
Validation auc = 0.696572
Epoch 2445
Loss = 7.8894e-02, PNorm = 461.2908, GNorm = 3.4547, lr_0 = 9.9861e-04
Validation auc = 0.694929
Epoch 2446
Loss = 3.9929e-02, PNorm = 461.4045, GNorm = 1.5074, lr_0 = 9.9861e-04
Validation auc = 0.693553
Epoch 2447
Loss = 2.0906e-02, PNorm = 461.5101, GNorm = 1.4581, lr_0 = 9.9861e-04
Validation auc = 0.697788
Epoch 2448
Loss = 3.7272e-02, PNorm = 461.5805, GNorm = 2.1017, lr_0 = 9.9861e-04
Validation auc = 0.701888
Epoch 2449
Loss = 4.0224e-02, PNorm = 461.6414, GNorm = 2.8272, lr_0 = 9.9861e-04
Loss = 7.2293e-02, PNorm = 461.7150, GNorm = 2.0561, lr_0 = 9.9861e-04
Validation auc = 0.708667
Epoch 2450
Loss = 5.1838e-02, PNorm = 461.7926, GNorm = 0.1139, lr_0 = 9.9861e-04
Validation auc = 0.710454
Epoch 2451
Loss = 4.8673e-02, PNorm = 461.8765, GNorm = 0.3979, lr_0 = 9.9860e-04
Validation auc = 0.708569
Epoch 2452
Loss = 6.6227e-02, PNorm = 461.9535, GNorm = 1.7190, lr_0 = 9.9860e-04
Validation auc = 0.708641
Epoch 2453
Loss = 5.7680e-02, PNorm = 462.0408, GNorm = 1.6218, lr_0 = 9.9860e-04
Validation auc = 0.718365
Epoch 2454
Loss = 3.0989e-02, PNorm = 462.1392, GNorm = 0.9056, lr_0 = 9.9860e-04
Validation auc = 0.715819
Epoch 2455
Loss = 3.5255e-02, PNorm = 462.2228, GNorm = 2.9004, lr_0 = 9.9860e-04
Validation auc = 0.712061
Epoch 2456
Loss = 5.1901e-02, PNorm = 462.3110, GNorm = 4.2667, lr_0 = 9.9860e-04
Validation auc = 0.712139
Epoch 2457
Loss = 5.1530e-03, PNorm = 462.4020, GNorm = 0.8694, lr_0 = 9.9860e-04
Validation auc = 0.725248
Epoch 2458
Loss = 4.4332e-03, PNorm = 462.5048, GNorm = 0.3130, lr_0 = 9.9860e-04
Validation auc = 0.732220
Epoch 2459
Loss = 6.2180e-02, PNorm = 462.6404, GNorm = 2.6786, lr_0 = 9.9860e-04
Loss = 1.0529e-01, PNorm = 462.8054, GNorm = 1.3403, lr_0 = 9.9860e-04
Validation auc = 0.729165
Epoch 2460
Loss = 4.2067e-02, PNorm = 462.9595, GNorm = 2.9457, lr_0 = 9.9860e-04
Validation auc = 0.709179
Epoch 2461
Loss = 7.0321e-02, PNorm = 463.0813, GNorm = 6.5363, lr_0 = 9.9860e-04
Validation auc = 0.696074
Epoch 2462
Loss = 5.6384e-02, PNorm = 463.2003, GNorm = 1.4241, lr_0 = 9.9860e-04
Validation auc = 0.686589
Epoch 2463
Loss = 5.0500e-02, PNorm = 463.3028, GNorm = 5.7101, lr_0 = 9.9860e-04
Validation auc = 0.701195
Epoch 2464
Loss = 7.9735e-02, PNorm = 463.4027, GNorm = 2.6943, lr_0 = 9.9859e-04
Validation auc = 0.713390
Epoch 2465
Loss = 4.2382e-02, PNorm = 463.5151, GNorm = 0.5881, lr_0 = 9.9859e-04
Validation auc = 0.719442
Epoch 2466
Loss = 4.3098e-02, PNorm = 463.6316, GNorm = 0.6147, lr_0 = 9.9859e-04
Validation auc = 0.720672
Epoch 2467
Loss = 7.9352e-02, PNorm = 463.7419, GNorm = 1.8838, lr_0 = 9.9859e-04
Validation auc = 0.722645
Epoch 2468
Loss = 7.6304e-02, PNorm = 463.8296, GNorm = 2.4536, lr_0 = 9.9859e-04
Validation auc = 0.733692
Epoch 2469
Loss = 1.6734e-02, PNorm = 463.9005, GNorm = 0.7061, lr_0 = 9.9859e-04
Loss = 3.1402e-02, PNorm = 463.9523, GNorm = 0.7919, lr_0 = 9.9859e-04
Validation auc = 0.734164
Epoch 2470
Loss = 6.0699e-02, PNorm = 464.0081, GNorm = 5.7751, lr_0 = 9.9859e-04
Validation auc = 0.732510
Epoch 2471
Loss = 2.9495e-02, PNorm = 464.0918, GNorm = 0.8330, lr_0 = 9.9859e-04
Validation auc = 0.727413
Epoch 2472
Loss = 2.3105e-02, PNorm = 464.1920, GNorm = 1.0650, lr_0 = 9.9859e-04
Validation auc = 0.714016
Epoch 2473
Loss = 2.8347e-02, PNorm = 464.2840, GNorm = 0.2810, lr_0 = 9.9859e-04
Validation auc = 0.710077
Epoch 2474
Loss = 4.1675e-02, PNorm = 464.3709, GNorm = 0.2605, lr_0 = 9.9859e-04
Validation auc = 0.708677
Epoch 2475
Loss = 1.0036e-01, PNorm = 464.4527, GNorm = 0.3229, lr_0 = 9.9859e-04
Validation auc = 0.707039
Epoch 2476
Loss = 1.6821e-02, PNorm = 464.5438, GNorm = 2.4512, lr_0 = 9.9859e-04
Validation auc = 0.707028
Epoch 2477
Loss = 2.7265e-02, PNorm = 464.6248, GNorm = 0.7385, lr_0 = 9.9859e-04
Validation auc = 0.716469
Epoch 2478
Loss = 1.9630e-01, PNorm = 464.7011, GNorm = 4.9310, lr_0 = 9.9858e-04
Validation auc = 0.722469
Epoch 2479
Loss = 2.2774e-02, PNorm = 464.7822, GNorm = 0.6414, lr_0 = 9.9858e-04
Loss = 9.1181e-02, PNorm = 464.8794, GNorm = 0.3072, lr_0 = 9.9858e-04
Validation auc = 0.706934
Epoch 2480
Loss = 3.7215e-02, PNorm = 464.9962, GNorm = 0.2059, lr_0 = 9.9858e-04
Validation auc = 0.686781
Epoch 2481
Loss = 5.5181e-02, PNorm = 465.0827, GNorm = 2.5231, lr_0 = 9.9858e-04
Validation auc = 0.696767
Epoch 2482
Loss = 4.4190e-02, PNorm = 465.1605, GNorm = 1.0260, lr_0 = 9.9858e-04
Validation auc = 0.704532
Epoch 2483
Loss = 6.1789e-02, PNorm = 465.2428, GNorm = 2.7456, lr_0 = 9.9858e-04
Validation auc = 0.696395
Epoch 2484
Loss = 5.3756e-02, PNorm = 465.3336, GNorm = 1.6289, lr_0 = 9.9858e-04
Validation auc = 0.699584
Epoch 2485
Loss = 4.7600e-03, PNorm = 465.4155, GNorm = 0.0349, lr_0 = 9.9858e-04
Validation auc = 0.703878
Epoch 2486
Loss = 5.3010e-03, PNorm = 465.4641, GNorm = 0.0109, lr_0 = 9.9858e-04
Validation auc = 0.710385
Epoch 2487
Loss = 9.1691e-02, PNorm = 465.5070, GNorm = 3.8302, lr_0 = 9.9858e-04
Validation auc = 0.715236
Epoch 2488
Loss = 1.5926e-01, PNorm = 465.5817, GNorm = 3.0112, lr_0 = 9.9858e-04
Validation auc = 0.700909
Epoch 2489
Loss = 1.4039e-02, PNorm = 465.6751, GNorm = 0.4329, lr_0 = 9.9858e-04
Loss = 7.0130e-02, PNorm = 465.7695, GNorm = 1.2517, lr_0 = 9.9858e-04
Validation auc = 0.699525
Epoch 2490
Loss = 7.2672e-02, PNorm = 465.8640, GNorm = 0.7726, lr_0 = 9.9858e-04
Validation auc = 0.709734
Epoch 2491
Loss = 2.6915e-02, PNorm = 465.9577, GNorm = 2.3883, lr_0 = 9.9857e-04
Validation auc = 0.708941
Epoch 2492
Loss = 4.5335e-02, PNorm = 466.0465, GNorm = 0.4760, lr_0 = 9.9857e-04
Validation auc = 0.707863
Epoch 2493
Loss = 2.0573e-02, PNorm = 466.1295, GNorm = 0.3963, lr_0 = 9.9857e-04
Validation auc = 0.706957
Epoch 2494
Loss = 5.7874e-02, PNorm = 466.2131, GNorm = 0.3869, lr_0 = 9.9857e-04
Validation auc = 0.692376
Epoch 2495
Loss = 4.8030e-02, PNorm = 466.3018, GNorm = 0.7436, lr_0 = 9.9857e-04
Validation auc = 0.706186
Epoch 2496
Loss = 3.2393e-02, PNorm = 466.3856, GNorm = 1.6912, lr_0 = 9.9857e-04
Validation auc = 0.717047
Epoch 2497
Loss = 1.2997e-02, PNorm = 466.4618, GNorm = 0.3119, lr_0 = 9.9857e-04
Validation auc = 0.711637
Epoch 2498
Loss = 2.5519e-02, PNorm = 466.5488, GNorm = 0.1954, lr_0 = 9.9857e-04
Validation auc = 0.721634
Epoch 2499
Loss = 8.5956e-03, PNorm = 466.6147, GNorm = 0.3679, lr_0 = 9.9857e-04
Loss = 2.9597e-02, PNorm = 466.6682, GNorm = 0.0266, lr_0 = 9.9857e-04
Validation auc = 0.728667
Epoch 2500
Loss = 1.1551e-01, PNorm = 466.7342, GNorm = 0.0817, lr_0 = 9.9857e-04
Validation auc = 0.709243
Epoch 2501
Loss = 4.9576e-02, PNorm = 466.8355, GNorm = 5.7977, lr_0 = 9.9857e-04
Validation auc = 0.700561
Epoch 2502
Loss = 7.2100e-02, PNorm = 466.9446, GNorm = 1.5411, lr_0 = 9.9857e-04
Validation auc = 0.704387
Epoch 2503
Loss = 2.3319e-02, PNorm = 467.0520, GNorm = 0.6045, lr_0 = 9.9857e-04
Validation auc = 0.712270
Epoch 2504
Loss = 1.0401e-01, PNorm = 467.1514, GNorm = 3.9774, lr_0 = 9.9856e-04
Validation auc = 0.728711
Epoch 2505
Loss = 1.2009e-02, PNorm = 467.2681, GNorm = 1.5923, lr_0 = 9.9856e-04
Validation auc = 0.740497
Epoch 2506
Loss = 2.0225e-02, PNorm = 467.3645, GNorm = 0.9088, lr_0 = 9.9856e-04
Validation auc = 0.735971
Epoch 2507
Loss = 4.5859e-02, PNorm = 467.4736, GNorm = 2.8679, lr_0 = 9.9856e-04
Validation auc = 0.725331
Epoch 2508
Loss = 1.3851e-02, PNorm = 467.5949, GNorm = 0.4218, lr_0 = 9.9856e-04
Validation auc = 0.724135
Epoch 2509
Loss = 4.3449e-02, PNorm = 467.7067, GNorm = 3.3899, lr_0 = 9.9856e-04
Loss = 8.0125e-02, PNorm = 467.8112, GNorm = 2.2140, lr_0 = 9.9856e-04
Validation auc = 0.714326
Epoch 2510
Loss = 4.0409e-02, PNorm = 467.9093, GNorm = 1.4560, lr_0 = 9.9856e-04
Validation auc = 0.702210
Epoch 2511
Loss = 9.7030e-02, PNorm = 468.0263, GNorm = 0.9040, lr_0 = 9.9856e-04
Validation auc = 0.692447
Epoch 2512
Loss = 6.2154e-02, PNorm = 468.1398, GNorm = 3.2240, lr_0 = 9.9856e-04
Validation auc = 0.686425
Epoch 2513
Loss = 9.4925e-02, PNorm = 468.2811, GNorm = 0.5202, lr_0 = 9.9856e-04
Validation auc = 0.659516
Epoch 2514
Loss = 3.9579e-02, PNorm = 468.4098, GNorm = 0.8753, lr_0 = 9.9856e-04
Validation auc = 0.651198
Epoch 2515
Loss = 5.8014e-02, PNorm = 468.5199, GNorm = 0.5894, lr_0 = 9.9856e-04
Validation auc = 0.656243
Epoch 2516
Loss = 3.8799e-02, PNorm = 468.6429, GNorm = 0.1206, lr_0 = 9.9856e-04
Validation auc = 0.680610
Epoch 2517
Loss = 3.2412e-02, PNorm = 468.7414, GNorm = 2.1611, lr_0 = 9.9856e-04
Validation auc = 0.706115
Epoch 2518
Loss = 4.4277e-02, PNorm = 468.8224, GNorm = 2.6928, lr_0 = 9.9855e-04
Validation auc = 0.702153
Epoch 2519
Loss = 4.7322e-02, PNorm = 468.9126, GNorm = 1.2124, lr_0 = 9.9855e-04
Loss = 4.6782e-02, PNorm = 468.9997, GNorm = 0.7925, lr_0 = 9.9855e-04
Validation auc = 0.704847
Epoch 2520
Loss = 4.1288e-02, PNorm = 469.0840, GNorm = 0.8523, lr_0 = 9.9855e-04
Validation auc = 0.704053
Epoch 2521
Loss = 1.5949e-02, PNorm = 469.1548, GNorm = 0.1352, lr_0 = 9.9855e-04
Validation auc = 0.702326
Epoch 2522
Loss = 1.7917e-02, PNorm = 469.2111, GNorm = 2.7346, lr_0 = 9.9855e-04
Validation auc = 0.696438
Epoch 2523
Loss = 8.7118e-02, PNorm = 469.2625, GNorm = 2.4097, lr_0 = 9.9855e-04
Validation auc = 0.702690
Epoch 2524
Loss = 3.2689e-02, PNorm = 469.3277, GNorm = 4.3646, lr_0 = 9.9855e-04
Validation auc = 0.704266
Epoch 2525
Loss = 2.2876e-02, PNorm = 469.4046, GNorm = 0.1892, lr_0 = 9.9855e-04
Validation auc = 0.721199
Epoch 2526
Loss = 3.0621e-03, PNorm = 469.4805, GNorm = 0.1463, lr_0 = 9.9855e-04
Validation auc = 0.721201
Epoch 2527
Loss = 3.4198e-02, PNorm = 469.5426, GNorm = 2.6943, lr_0 = 9.9855e-04
Validation auc = 0.726034
Epoch 2528
Loss = 6.2611e-03, PNorm = 469.5957, GNorm = 0.5119, lr_0 = 9.9855e-04
Validation auc = 0.727530
Epoch 2529
Loss = 2.2533e-01, PNorm = 469.6501, GNorm = 4.0351, lr_0 = 9.9855e-04
Loss = 2.5462e-02, PNorm = 469.7268, GNorm = 1.6075, lr_0 = 9.9855e-04
Validation auc = 0.727248
Epoch 2530
Loss = 2.4115e-02, PNorm = 469.7997, GNorm = 0.0228, lr_0 = 9.9854e-04
Validation auc = 0.737731
Epoch 2531
Loss = 6.0274e-02, PNorm = 469.8940, GNorm = 2.2168, lr_0 = 9.9854e-04
Validation auc = 0.740432
Epoch 2532
Loss = 8.8834e-02, PNorm = 469.9846, GNorm = 4.8109, lr_0 = 9.9854e-04
Validation auc = 0.738456
Epoch 2533
Loss = 4.7903e-02, PNorm = 470.0641, GNorm = 2.2294, lr_0 = 9.9854e-04
Validation auc = 0.738348
Epoch 2534
Loss = 2.2734e-02, PNorm = 470.1313, GNorm = 1.0352, lr_0 = 9.9854e-04
Validation auc = 0.737429
Epoch 2535
Loss = 6.9967e-02, PNorm = 470.1804, GNorm = 6.7614, lr_0 = 9.9854e-04
Validation auc = 0.737790
Epoch 2536
Loss = 6.9039e-02, PNorm = 470.2462, GNorm = 4.3039, lr_0 = 9.9854e-04
Validation auc = 0.727787
Epoch 2537
Loss = 1.2969e-02, PNorm = 470.3147, GNorm = 0.5428, lr_0 = 9.9854e-04
Validation auc = 0.719606
Epoch 2538
Loss = 5.0663e-02, PNorm = 470.3854, GNorm = 1.9977, lr_0 = 9.9854e-04
Validation auc = 0.709636
Epoch 2539
Loss = 1.6269e-02, PNorm = 470.4629, GNorm = 0.5048, lr_0 = 9.9854e-04
Loss = 5.0993e-02, PNorm = 470.5436, GNorm = 0.1959, lr_0 = 9.9854e-04
Validation auc = 0.704865
Epoch 2540
Loss = 6.4637e-02, PNorm = 470.6267, GNorm = 2.4876, lr_0 = 9.9854e-04
Validation auc = 0.703955
Epoch 2541
Loss = 6.7812e-02, PNorm = 470.7149, GNorm = 1.3036, lr_0 = 9.9854e-04
Validation auc = 0.714899
Epoch 2542
Loss = 3.2752e-02, PNorm = 470.8033, GNorm = 2.2859, lr_0 = 9.9854e-04
Validation auc = 0.721834
Epoch 2543
Loss = 3.0035e-02, PNorm = 470.8716, GNorm = 1.4161, lr_0 = 9.9854e-04
Validation auc = 0.720258
Epoch 2544
Loss = 7.5142e-02, PNorm = 470.9373, GNorm = 4.1462, lr_0 = 9.9853e-04
Validation auc = 0.711556
Epoch 2545
Loss = 3.1507e-02, PNorm = 471.0270, GNorm = 1.6011, lr_0 = 9.9853e-04
Validation auc = 0.713421
Epoch 2546
Loss = 1.3525e-02, PNorm = 471.1032, GNorm = 0.2081, lr_0 = 9.9853e-04
Validation auc = 0.720418
Epoch 2547
Loss = 2.7349e-02, PNorm = 471.1624, GNorm = 1.3134, lr_0 = 9.9853e-04
Validation auc = 0.727864
Epoch 2548
Loss = 1.3811e-01, PNorm = 471.2313, GNorm = 0.6061, lr_0 = 9.9853e-04
Validation auc = 0.737800
Epoch 2549
Loss = 7.5580e-03, PNorm = 471.3050, GNorm = 0.2419, lr_0 = 9.9853e-04
Loss = 7.4754e-02, PNorm = 471.3802, GNorm = 4.4844, lr_0 = 9.9853e-04
Validation auc = 0.750179
Epoch 2550
Loss = 6.8993e-02, PNorm = 471.4740, GNorm = 0.0955, lr_0 = 9.9853e-04
Validation auc = 0.734988
Epoch 2551
Loss = 4.1471e-02, PNorm = 471.5650, GNorm = 1.1134, lr_0 = 9.9853e-04
Validation auc = 0.722454
Epoch 2552
Loss = 7.6066e-02, PNorm = 471.6399, GNorm = 1.2645, lr_0 = 9.9853e-04
Validation auc = 0.715452
Epoch 2553
Loss = 3.6206e-02, PNorm = 471.7301, GNorm = 1.2635, lr_0 = 9.9853e-04
Validation auc = 0.727294
Epoch 2554
Loss = 1.8252e-02, PNorm = 471.8119, GNorm = 0.3055, lr_0 = 9.9853e-04
Validation auc = 0.729529
Epoch 2555
Loss = 2.0960e-02, PNorm = 471.8762, GNorm = 0.3202, lr_0 = 9.9853e-04
Validation auc = 0.719985
Epoch 2556
Loss = 3.9194e-02, PNorm = 471.9375, GNorm = 2.1741, lr_0 = 9.9853e-04
Validation auc = 0.724672
Epoch 2557
Loss = 9.0407e-02, PNorm = 472.0272, GNorm = 0.1324, lr_0 = 9.9852e-04
Validation auc = 0.725227
Epoch 2558
Loss = 9.0262e-02, PNorm = 472.1284, GNorm = 0.2689, lr_0 = 9.9852e-04
Validation auc = 0.736477
Epoch 2559
Loss = 4.5293e-03, PNorm = 472.2360, GNorm = 0.2772, lr_0 = 9.9852e-04
Loss = 4.2100e-02, PNorm = 472.3209, GNorm = 0.6857, lr_0 = 9.9852e-04
Validation auc = 0.734167
Epoch 2560
Loss = 4.3282e-02, PNorm = 472.4070, GNorm = 1.5744, lr_0 = 9.9852e-04
Validation auc = 0.739975
Epoch 2561
Loss = 5.2664e-02, PNorm = 472.4915, GNorm = 0.2051, lr_0 = 9.9852e-04
Validation auc = 0.748218
Epoch 2562
Loss = 2.3850e-02, PNorm = 472.5638, GNorm = 1.7403, lr_0 = 9.9852e-04
Validation auc = 0.743215
Epoch 2563
Loss = 3.2483e-02, PNorm = 472.6124, GNorm = 2.9649, lr_0 = 9.9852e-04
Validation auc = 0.741098
Epoch 2564
Loss = 2.8680e-02, PNorm = 472.6533, GNorm = 1.0413, lr_0 = 9.9852e-04
Validation auc = 0.734120
Epoch 2565
Loss = 9.4907e-03, PNorm = 472.6927, GNorm = 1.6825, lr_0 = 9.9852e-04
Validation auc = 0.732064
Epoch 2566
Loss = 3.0159e-02, PNorm = 472.7298, GNorm = 0.0198, lr_0 = 9.9852e-04
Validation auc = 0.745480
Epoch 2567
Loss = 5.6505e-03, PNorm = 472.8013, GNorm = 0.1093, lr_0 = 9.9852e-04
Validation auc = 0.738378
Epoch 2568
Loss = 1.8861e-01, PNorm = 472.9003, GNorm = 6.3093, lr_0 = 9.9852e-04
Validation auc = 0.738284
Epoch 2569
Loss = 5.1755e-02, PNorm = 473.0393, GNorm = 1.9707, lr_0 = 9.9852e-04
Loss = 7.0083e-02, PNorm = 473.1712, GNorm = 3.8947, lr_0 = 9.9852e-04
Validation auc = 0.737827
Epoch 2570
Loss = 9.5712e-02, PNorm = 473.2866, GNorm = 3.7116, lr_0 = 9.9851e-04
Validation auc = 0.724175
Epoch 2571
Loss = 4.8563e-02, PNorm = 473.4071, GNorm = 0.5056, lr_0 = 9.9851e-04
Validation auc = 0.729458
Epoch 2572
Loss = 6.3227e-02, PNorm = 473.5071, GNorm = 1.5219, lr_0 = 9.9851e-04
Validation auc = 0.736470
Epoch 2573
Loss = 1.7455e-02, PNorm = 473.5990, GNorm = 0.0657, lr_0 = 9.9851e-04
Validation auc = 0.733378
Epoch 2574
Loss = 1.0250e-01, PNorm = 473.6683, GNorm = 3.7677, lr_0 = 9.9851e-04
Validation auc = 0.726296
Epoch 2575
Loss = 1.2944e-02, PNorm = 473.7427, GNorm = 0.2873, lr_0 = 9.9851e-04
Validation auc = 0.716425
Epoch 2576
Loss = 2.5962e-02, PNorm = 473.8197, GNorm = 0.5984, lr_0 = 9.9851e-04
Validation auc = 0.720914
Epoch 2577
Loss = 6.7477e-02, PNorm = 473.9043, GNorm = 0.0417, lr_0 = 9.9851e-04
Validation auc = 0.721890
Epoch 2578
Loss = 5.3169e-02, PNorm = 474.0088, GNorm = 1.7970, lr_0 = 9.9851e-04
Validation auc = 0.722344
Epoch 2579
Loss = 2.0574e-02, PNorm = 474.0932, GNorm = 1.1363, lr_0 = 9.9851e-04
Loss = 4.7838e-02, PNorm = 474.1684, GNorm = 0.4370, lr_0 = 9.9851e-04
Validation auc = 0.715043
Epoch 2580
Loss = 5.1799e-02, PNorm = 474.2477, GNorm = 0.9977, lr_0 = 9.9851e-04
Validation auc = 0.721037
Epoch 2581
Loss = 4.5296e-02, PNorm = 474.3487, GNorm = 0.5130, lr_0 = 9.9851e-04
Validation auc = 0.724161
Epoch 2582
Loss = 2.8254e-02, PNorm = 474.4217, GNorm = 0.1109, lr_0 = 9.9851e-04
Validation auc = 0.726071
Epoch 2583
Loss = 5.5922e-02, PNorm = 474.4900, GNorm = 1.3008, lr_0 = 9.9850e-04
Validation auc = 0.727829
Epoch 2584
Loss = 3.6418e-02, PNorm = 474.5663, GNorm = 0.6306, lr_0 = 9.9850e-04
Validation auc = 0.726779
Epoch 2585
Loss = 1.1705e-02, PNorm = 474.6307, GNorm = 0.9307, lr_0 = 9.9850e-04
Validation auc = 0.727477
Epoch 2586
Loss = 3.7688e-02, PNorm = 474.6926, GNorm = 0.0758, lr_0 = 9.9850e-04
Validation auc = 0.716162
Epoch 2587
Loss = 2.5178e-02, PNorm = 474.7671, GNorm = 0.9907, lr_0 = 9.9850e-04
Validation auc = 0.710480
Epoch 2588
Loss = 1.3612e-01, PNorm = 474.8437, GNorm = 3.5312, lr_0 = 9.9850e-04
Validation auc = 0.709623
Epoch 2589
Loss = 2.5390e-03, PNorm = 474.9142, GNorm = 0.2094, lr_0 = 9.9850e-04
Loss = 4.6668e-02, PNorm = 474.9715, GNorm = 0.4862, lr_0 = 9.9850e-04
Validation auc = 0.711834
Epoch 2590
Loss = 2.5369e-02, PNorm = 475.0347, GNorm = 0.8810, lr_0 = 9.9850e-04
Validation auc = 0.714416
Epoch 2591
Loss = 2.7543e-02, PNorm = 475.0887, GNorm = 0.0615, lr_0 = 9.9850e-04
Validation auc = 0.706872
Epoch 2592
Loss = 1.7946e-02, PNorm = 475.1468, GNorm = 1.0088, lr_0 = 9.9850e-04
Validation auc = 0.704687
Epoch 2593
Loss = 3.9195e-02, PNorm = 475.2035, GNorm = 3.6477, lr_0 = 9.9850e-04
Validation auc = 0.712258
Epoch 2594
Loss = 2.9127e-02, PNorm = 475.2637, GNorm = 0.4329, lr_0 = 9.9850e-04
Validation auc = 0.707570
Epoch 2595
Loss = 1.0265e-02, PNorm = 475.3548, GNorm = 0.4244, lr_0 = 9.9850e-04
Validation auc = 0.705556
Epoch 2596
Loss = 2.4162e-02, PNorm = 475.4668, GNorm = 0.2188, lr_0 = 9.9850e-04
Validation auc = 0.714849
Epoch 2597
Loss = 1.0654e-01, PNorm = 475.5643, GNorm = 0.3786, lr_0 = 9.9849e-04
Validation auc = 0.698647
Epoch 2598
Loss = 1.7107e-02, PNorm = 475.6539, GNorm = 2.8530, lr_0 = 9.9849e-04
Validation auc = 0.683206
Epoch 2599
Loss = 4.5336e-02, PNorm = 475.7387, GNorm = 2.2837, lr_0 = 9.9849e-04
Loss = 8.4639e-02, PNorm = 475.8546, GNorm = 1.2491, lr_0 = 9.9849e-04
Validation auc = 0.682955
Epoch 2600
Loss = 4.6436e-02, PNorm = 475.9651, GNorm = 0.5778, lr_0 = 9.9849e-04
Validation auc = 0.692931
Epoch 2601
Loss = 4.9526e-02, PNorm = 476.0616, GNorm = 1.2870, lr_0 = 9.9849e-04
Validation auc = 0.704684
Epoch 2602
Loss = 1.0404e-01, PNorm = 476.1529, GNorm = 3.2061, lr_0 = 9.9849e-04
Validation auc = 0.697635
Epoch 2603
Loss = 1.2816e-01, PNorm = 476.2751, GNorm = 7.3522, lr_0 = 9.9849e-04
Validation auc = 0.692686
Epoch 2604
Loss = 3.9609e-02, PNorm = 476.4014, GNorm = 2.6226, lr_0 = 9.9849e-04
Validation auc = 0.700180
Epoch 2605
Loss = 1.2691e-02, PNorm = 476.5039, GNorm = 0.0713, lr_0 = 9.9849e-04
Validation auc = 0.706836
Epoch 2606
Loss = 1.9947e-02, PNorm = 476.5768, GNorm = 0.0600, lr_0 = 9.9849e-04
Validation auc = 0.717363
Epoch 2607
Loss = 1.9986e-02, PNorm = 476.6339, GNorm = 0.0194, lr_0 = 9.9849e-04
Validation auc = 0.726393
Epoch 2608
Loss = 1.2663e-01, PNorm = 476.6933, GNorm = 0.2939, lr_0 = 9.9849e-04
Validation auc = 0.738416
Epoch 2609
Loss = 2.2246e-01, PNorm = 476.7935, GNorm = 6.1173, lr_0 = 9.9849e-04
Loss = 2.2746e-02, PNorm = 476.8875, GNorm = 1.7500, lr_0 = 9.9848e-04
Validation auc = 0.735244
Epoch 2610
Loss = 3.2857e-02, PNorm = 476.9613, GNorm = 1.6481, lr_0 = 9.9848e-04
Validation auc = 0.738158
Epoch 2611
Loss = 5.3651e-02, PNorm = 477.0238, GNorm = 0.1097, lr_0 = 9.9848e-04
Validation auc = 0.734249
Epoch 2612
Loss = 1.5420e-01, PNorm = 477.1174, GNorm = 6.7165, lr_0 = 9.9848e-04
Validation auc = 0.726740
Epoch 2613
Loss = 3.8173e-02, PNorm = 477.2391, GNorm = 0.2918, lr_0 = 9.9848e-04
Validation auc = 0.734537
Epoch 2614
Loss = 3.6813e-02, PNorm = 477.3517, GNorm = 0.1039, lr_0 = 9.9848e-04
Validation auc = 0.737645
Epoch 2615
Loss = 7.4506e-02, PNorm = 477.4402, GNorm = 1.9861, lr_0 = 9.9848e-04
Validation auc = 0.731474
Epoch 2616
Loss = 3.4396e-02, PNorm = 477.5278, GNorm = 5.1488, lr_0 = 9.9848e-04
Validation auc = 0.725281
Epoch 2617
Loss = 3.1100e-02, PNorm = 477.6041, GNorm = 2.0488, lr_0 = 9.9848e-04
Validation auc = 0.723824
Epoch 2618
Loss = 5.3629e-03, PNorm = 477.6756, GNorm = 0.2212, lr_0 = 9.9848e-04
Validation auc = 0.710954
Epoch 2619
Loss = 7.0443e-02, PNorm = 477.7584, GNorm = 2.2178, lr_0 = 9.9848e-04
Loss = 1.7725e-02, PNorm = 477.8315, GNorm = 0.6776, lr_0 = 9.9848e-04
Validation auc = 0.716364
Epoch 2620
Loss = 3.3346e-02, PNorm = 477.8942, GNorm = 0.2356, lr_0 = 9.9848e-04
Validation auc = 0.721961
Epoch 2621
Loss = 4.3880e-02, PNorm = 477.9379, GNorm = 2.4261, lr_0 = 9.9848e-04
Validation auc = 0.715156
Epoch 2622
Loss = 2.0238e-02, PNorm = 477.9791, GNorm = 0.2138, lr_0 = 9.9848e-04
Validation auc = 0.709970
Epoch 2623
Loss = 7.5212e-03, PNorm = 478.0536, GNorm = 0.1500, lr_0 = 9.9847e-04
Validation auc = 0.706775
Epoch 2624
Loss = 1.1904e-02, PNorm = 478.1110, GNorm = 0.5977, lr_0 = 9.9847e-04
Validation auc = 0.710115
Epoch 2625
Loss = 3.1020e-02, PNorm = 478.1730, GNorm = 1.4302, lr_0 = 9.9847e-04
Validation auc = 0.727784
Epoch 2626
Loss = 2.9378e-02, PNorm = 478.2381, GNorm = 0.0662, lr_0 = 9.9847e-04
Validation auc = 0.736314
Epoch 2627
Loss = 2.1913e-02, PNorm = 478.2795, GNorm = 1.7907, lr_0 = 9.9847e-04
Validation auc = 0.738612
Epoch 2628
Loss = 6.1853e-02, PNorm = 478.3168, GNorm = 6.9755, lr_0 = 9.9847e-04
Validation auc = 0.726061
Epoch 2629
Loss = 2.2014e-02, PNorm = 478.3881, GNorm = 0.7775, lr_0 = 9.9847e-04
Loss = 6.2514e-02, PNorm = 478.4932, GNorm = 2.6847, lr_0 = 9.9847e-04
Validation auc = 0.726874
Epoch 2630
Loss = 4.7807e-02, PNorm = 478.5911, GNorm = 0.6731, lr_0 = 9.9847e-04
Validation auc = 0.723383
Epoch 2631
Loss = 2.3410e-02, PNorm = 478.6647, GNorm = 0.9893, lr_0 = 9.9847e-04
Validation auc = 0.731670
Epoch 2632
Loss = 2.7935e-02, PNorm = 478.7109, GNorm = 0.7231, lr_0 = 9.9847e-04
Validation auc = 0.738183
Epoch 2633
Loss = 6.6785e-02, PNorm = 478.7481, GNorm = 0.0480, lr_0 = 9.9847e-04
Validation auc = 0.726873
Epoch 2634
Loss = 4.7166e-02, PNorm = 478.8044, GNorm = 0.4319, lr_0 = 9.9847e-04
Validation auc = 0.727866
Epoch 2635
Loss = 6.4908e-02, PNorm = 478.8583, GNorm = 0.3544, lr_0 = 9.9847e-04
Validation auc = 0.725491
Epoch 2636
Loss = 3.3574e-02, PNorm = 478.9116, GNorm = 0.8559, lr_0 = 9.9847e-04
Validation auc = 0.724892
Epoch 2637
Loss = 1.9660e-03, PNorm = 478.9741, GNorm = 0.1296, lr_0 = 9.9846e-04
Validation auc = 0.721936
Epoch 2638
Loss = 1.5575e-02, PNorm = 479.0276, GNorm = 0.9976, lr_0 = 9.9846e-04
Validation auc = 0.723346
Epoch 2639
Loss = 3.9367e-03, PNorm = 479.0767, GNorm = 0.3983, lr_0 = 9.9846e-04
Loss = 4.0689e-02, PNorm = 479.1286, GNorm = 0.1728, lr_0 = 9.9846e-04
Validation auc = 0.727245
Epoch 2640
Loss = 1.5921e-02, PNorm = 479.1830, GNorm = 0.3312, lr_0 = 9.9846e-04
Validation auc = 0.732399
Epoch 2641
Loss = 3.7313e-02, PNorm = 479.2526, GNorm = 1.7217, lr_0 = 9.9846e-04
Validation auc = 0.744540
Epoch 2642
Loss = 4.9816e-02, PNorm = 479.3167, GNorm = 1.5821, lr_0 = 9.9846e-04
Validation auc = 0.747705
Epoch 2643
Loss = 3.4924e-02, PNorm = 479.3875, GNorm = 1.5971, lr_0 = 9.9846e-04
Validation auc = 0.746750
Epoch 2644
Loss = 3.5823e-02, PNorm = 479.4487, GNorm = 0.1495, lr_0 = 9.9846e-04
Validation auc = 0.746797
Epoch 2645
Loss = 3.9602e-02, PNorm = 479.4954, GNorm = 0.1459, lr_0 = 9.9846e-04
Validation auc = 0.750290
Epoch 2646
Loss = 1.5244e-02, PNorm = 479.5396, GNorm = 0.0401, lr_0 = 9.9846e-04
Validation auc = 0.749164
Epoch 2647
Loss = 2.4442e-02, PNorm = 479.5873, GNorm = 2.2431, lr_0 = 9.9846e-04
Validation auc = 0.750872
Epoch 2648
Loss = 8.1820e-03, PNorm = 479.6435, GNorm = 0.7933, lr_0 = 9.9846e-04
Validation auc = 0.741716
Epoch 2649
Loss = 6.5596e-02, PNorm = 479.7189, GNorm = 3.6249, lr_0 = 9.9846e-04
Loss = 3.8705e-02, PNorm = 479.8108, GNorm = 0.5692, lr_0 = 9.9845e-04
Validation auc = 0.752026
Epoch 2650
Loss = 2.4014e-02, PNorm = 479.9121, GNorm = 0.0336, lr_0 = 9.9845e-04
Validation auc = 0.757704
Epoch 2651
Loss = 9.6206e-02, PNorm = 479.9915, GNorm = 6.6077, lr_0 = 9.9845e-04
Validation auc = 0.748165
Epoch 2652
Loss = 2.7476e-02, PNorm = 480.0818, GNorm = 0.6368, lr_0 = 9.9845e-04
Validation auc = 0.738272
Epoch 2653
Loss = 4.8504e-02, PNorm = 480.1820, GNorm = 2.2453, lr_0 = 9.9845e-04
Validation auc = 0.724710
Epoch 2654
Loss = 5.7037e-02, PNorm = 480.2813, GNorm = 1.1602, lr_0 = 9.9845e-04
Validation auc = 0.721140
Epoch 2655
Loss = 7.2818e-02, PNorm = 480.3887, GNorm = 0.2303, lr_0 = 9.9845e-04
Validation auc = 0.721861
Epoch 2656
Loss = 4.5235e-02, PNorm = 480.4922, GNorm = 1.3860, lr_0 = 9.9845e-04
Validation auc = 0.733955
Epoch 2657
Loss = 2.9787e-02, PNorm = 480.5823, GNorm = 0.7633, lr_0 = 9.9845e-04
Validation auc = 0.731854
Epoch 2658
Loss = 1.8577e-02, PNorm = 480.6705, GNorm = 0.7334, lr_0 = 9.9845e-04
Validation auc = 0.722392
Epoch 2659
Loss = 2.0149e-02, PNorm = 480.7742, GNorm = 0.8796, lr_0 = 9.9845e-04
Loss = 3.6160e-02, PNorm = 480.8722, GNorm = 0.5436, lr_0 = 9.9845e-04
Validation auc = 0.719445
Epoch 2660
Loss = 4.5874e-02, PNorm = 480.9413, GNorm = 4.2897, lr_0 = 9.9845e-04
Validation auc = 0.716300
Epoch 2661
Loss = 2.3102e-02, PNorm = 481.0112, GNorm = 0.8130, lr_0 = 9.9845e-04
Validation auc = 0.714841
Epoch 2662
Loss = 8.1974e-02, PNorm = 481.0836, GNorm = 0.9837, lr_0 = 9.9845e-04
Validation auc = 0.721278
Epoch 2663
Loss = 1.9690e-02, PNorm = 481.1530, GNorm = 0.1219, lr_0 = 9.9844e-04
Validation auc = 0.726089
Epoch 2664
Loss = 1.7381e-02, PNorm = 481.2056, GNorm = 0.1319, lr_0 = 9.9844e-04
Validation auc = 0.729539
Epoch 2665
Loss = 5.7019e-02, PNorm = 481.2495, GNorm = 1.1725, lr_0 = 9.9844e-04
Validation auc = 0.728743
Epoch 2666
Loss = 7.2004e-02, PNorm = 481.3044, GNorm = 0.9910, lr_0 = 9.9844e-04
Validation auc = 0.727367
Epoch 2667
Loss = 2.5502e-02, PNorm = 481.3772, GNorm = 0.9230, lr_0 = 9.9844e-04
Validation auc = 0.724509
Epoch 2668
Loss = 6.8741e-02, PNorm = 481.4427, GNorm = 1.4928, lr_0 = 9.9844e-04
Validation auc = 0.729481
Epoch 2669
Loss = 6.9875e-03, PNorm = 481.5065, GNorm = 0.3231, lr_0 = 9.9844e-04
Loss = 3.2092e-02, PNorm = 481.5675, GNorm = 3.7394, lr_0 = 9.9844e-04
Validation auc = 0.740411
Epoch 2670
Loss = 2.7726e-02, PNorm = 481.6292, GNorm = 0.4605, lr_0 = 9.9844e-04
Validation auc = 0.747689
Epoch 2671
Loss = 1.2233e-02, PNorm = 481.6933, GNorm = 0.0289, lr_0 = 9.9844e-04
Validation auc = 0.746044
Epoch 2672
Loss = 5.4218e-03, PNorm = 481.7389, GNorm = 0.2459, lr_0 = 9.9844e-04
Validation auc = 0.746370
Epoch 2673
Loss = 1.7246e-02, PNorm = 481.7799, GNorm = 0.1982, lr_0 = 9.9844e-04
Validation auc = 0.744914
Epoch 2674
Loss = 2.6718e-02, PNorm = 481.8226, GNorm = 0.1342, lr_0 = 9.9844e-04
Validation auc = 0.741563
Epoch 2675
Loss = 3.4727e-02, PNorm = 481.8667, GNorm = 0.0221, lr_0 = 9.9844e-04
Validation auc = 0.738485
Epoch 2676
Loss = 2.7577e-02, PNorm = 481.9260, GNorm = 0.3326, lr_0 = 9.9843e-04
Validation auc = 0.741978
Epoch 2677
Loss = 1.6208e-01, PNorm = 481.9887, GNorm = 4.6137, lr_0 = 9.9843e-04
Validation auc = 0.744492
Epoch 2678
Loss = 2.1391e-02, PNorm = 482.0659, GNorm = 1.6729, lr_0 = 9.9843e-04
Validation auc = 0.743909
Epoch 2679
Loss = 1.4086e-01, PNorm = 482.1365, GNorm = 5.6445, lr_0 = 9.9843e-04
Loss = 7.3793e-02, PNorm = 482.2270, GNorm = 1.1783, lr_0 = 9.9843e-04
Validation auc = 0.740440
Epoch 2680
Loss = 2.3342e-02, PNorm = 482.3168, GNorm = 1.9845, lr_0 = 9.9843e-04
Validation auc = 0.735471
Epoch 2681
Loss = 4.8319e-02, PNorm = 482.4003, GNorm = 1.5564, lr_0 = 9.9843e-04
Validation auc = 0.732914
Epoch 2682
Loss = 9.7551e-02, PNorm = 482.4721, GNorm = 5.1039, lr_0 = 9.9843e-04
Validation auc = 0.729196
Epoch 2683
Loss = 1.0122e-01, PNorm = 482.5546, GNorm = 0.6331, lr_0 = 9.9843e-04
Validation auc = 0.717332
Epoch 2684
Loss = 1.0245e-01, PNorm = 482.6352, GNorm = 0.9882, lr_0 = 9.9843e-04
Validation auc = 0.723792
Epoch 2685
Loss = 1.0339e-01, PNorm = 482.7140, GNorm = 3.4532, lr_0 = 9.9843e-04
Validation auc = 0.722648
Epoch 2686
Loss = 1.9822e-02, PNorm = 482.8016, GNorm = 0.7188, lr_0 = 9.9843e-04
Validation auc = 0.721808
Epoch 2687
Loss = 4.4999e-02, PNorm = 482.8777, GNorm = 0.4199, lr_0 = 9.9843e-04
Validation auc = 0.729851
Epoch 2688
Loss = 7.6023e-02, PNorm = 482.9455, GNorm = 0.8420, lr_0 = 9.9843e-04
Validation auc = 0.734650
Epoch 2689
Loss = 1.8226e-03, PNorm = 482.9972, GNorm = 0.1092, lr_0 = 9.9843e-04
Loss = 1.4036e-02, PNorm = 483.0302, GNorm = 0.4044, lr_0 = 9.9842e-04
Validation auc = 0.736133
Epoch 2690
Loss = 4.0336e-02, PNorm = 483.0631, GNorm = 0.8751, lr_0 = 9.9842e-04
Validation auc = 0.740587
Epoch 2691
Loss = 3.4323e-02, PNorm = 483.1146, GNorm = 4.4048, lr_0 = 9.9842e-04
Validation auc = 0.743602
Epoch 2692
Loss = 4.6340e-02, PNorm = 483.1829, GNorm = 0.3125, lr_0 = 9.9842e-04
Validation auc = 0.738494
Epoch 2693
Loss = 2.1000e-02, PNorm = 483.2545, GNorm = 1.4569, lr_0 = 9.9842e-04
Validation auc = 0.723220
Epoch 2694
Loss = 5.2108e-02, PNorm = 483.3201, GNorm = 2.5320, lr_0 = 9.9842e-04
Validation auc = 0.715215
Epoch 2695
Loss = 4.5106e-02, PNorm = 483.3884, GNorm = 1.0425, lr_0 = 9.9842e-04
Validation auc = 0.725450
Epoch 2696
Loss = 7.4685e-02, PNorm = 483.4799, GNorm = 0.6105, lr_0 = 9.9842e-04
Validation auc = 0.723529
Epoch 2697
Loss = 1.8046e-02, PNorm = 483.5659, GNorm = 1.7177, lr_0 = 9.9842e-04
Validation auc = 0.711356
Epoch 2698
Loss = 2.0362e-02, PNorm = 483.6577, GNorm = 2.0182, lr_0 = 9.9842e-04
Validation auc = 0.709996
Epoch 2699
Loss = 3.9471e-02, PNorm = 483.7591, GNorm = 1.1356, lr_0 = 9.9842e-04
Loss = 2.5399e-02, PNorm = 483.8642, GNorm = 0.2110, lr_0 = 9.9842e-04
Validation auc = 0.711795
Epoch 2700
Loss = 4.3863e-02, PNorm = 483.9511, GNorm = 0.1307, lr_0 = 9.9842e-04
Validation auc = 0.716203
Epoch 2701
Loss = 5.1717e-02, PNorm = 484.0291, GNorm = 0.3685, lr_0 = 9.9842e-04
Validation auc = 0.715805
Epoch 2702
Loss = 1.9859e-02, PNorm = 484.1112, GNorm = 1.1250, lr_0 = 9.9841e-04
Validation auc = 0.714194
Epoch 2703
Loss = 4.8268e-02, PNorm = 484.1893, GNorm = 0.2584, lr_0 = 9.9841e-04
Validation auc = 0.702615
Epoch 2704
Loss = 7.4987e-02, PNorm = 484.2881, GNorm = 0.7300, lr_0 = 9.9841e-04
Validation auc = 0.699802
Epoch 2705
Loss = 2.6737e-01, PNorm = 484.4153, GNorm = 3.0283, lr_0 = 9.9841e-04
Validation auc = 0.707072
Epoch 2706
Loss = 2.5073e-02, PNorm = 484.5834, GNorm = 1.7199, lr_0 = 9.9841e-04
Validation auc = 0.707996
Epoch 2707
Loss = 8.7741e-02, PNorm = 484.7197, GNorm = 5.8073, lr_0 = 9.9841e-04
Validation auc = 0.711626
Epoch 2708
Loss = 1.6740e-02, PNorm = 484.8618, GNorm = 0.7634, lr_0 = 9.9841e-04
Validation auc = 0.713555
Epoch 2709
Loss = 1.5307e-02, PNorm = 484.9642, GNorm = 0.4518, lr_0 = 9.9841e-04
Loss = 4.1480e-02, PNorm = 485.0449, GNorm = 0.1335, lr_0 = 9.9841e-04
Validation auc = 0.694732
Epoch 2710
Loss = 2.3764e-02, PNorm = 485.1177, GNorm = 4.0478, lr_0 = 9.9841e-04
Validation auc = 0.684909
Epoch 2711
Loss = 8.1776e-02, PNorm = 485.1971, GNorm = 2.8823, lr_0 = 9.9841e-04
Validation auc = 0.692091
Epoch 2712
Loss = 6.0615e-02, PNorm = 485.2765, GNorm = 2.6525, lr_0 = 9.9841e-04
Validation auc = 0.700148
Epoch 2713
Loss = 4.2749e-02, PNorm = 485.3458, GNorm = 3.0178, lr_0 = 9.9841e-04
Validation auc = 0.705676
Epoch 2714
Loss = 1.0357e-01, PNorm = 485.4276, GNorm = 1.6242, lr_0 = 9.9841e-04
Validation auc = 0.708463
Epoch 2715
Loss = 2.4965e-02, PNorm = 485.5217, GNorm = 1.4654, lr_0 = 9.9841e-04
Validation auc = 0.710597
Epoch 2716
Loss = 1.6969e-02, PNorm = 485.6099, GNorm = 0.4264, lr_0 = 9.9840e-04
Validation auc = 0.706830
Epoch 2717
Loss = 3.7717e-02, PNorm = 485.7092, GNorm = 3.1979, lr_0 = 9.9840e-04
Validation auc = 0.706371
Epoch 2718
Loss = 4.0626e-02, PNorm = 485.8192, GNorm = 0.1052, lr_0 = 9.9840e-04
Validation auc = 0.701881
Epoch 2719
Loss = 2.8593e-03, PNorm = 485.9058, GNorm = 0.1244, lr_0 = 9.9840e-04
Loss = 5.0752e-02, PNorm = 485.9880, GNorm = 1.0164, lr_0 = 9.9840e-04
Validation auc = 0.706707
Epoch 2720
Loss = 2.0723e-02, PNorm = 486.0727, GNorm = 0.7089, lr_0 = 9.9840e-04
Validation auc = 0.693268
Epoch 2721
Loss = 2.5796e-02, PNorm = 486.1399, GNorm = 0.8130, lr_0 = 9.9840e-04
Validation auc = 0.701976
Epoch 2722
Loss = 3.9518e-02, PNorm = 486.1938, GNorm = 0.1851, lr_0 = 9.9840e-04
Validation auc = 0.703574
Epoch 2723
Loss = 7.2631e-02, PNorm = 486.2553, GNorm = 3.9475, lr_0 = 9.9840e-04
Validation auc = 0.695376
Epoch 2724
Loss = 1.3606e-02, PNorm = 486.3286, GNorm = 0.3311, lr_0 = 9.9840e-04
Validation auc = 0.698692
Epoch 2725
Loss = 7.5184e-02, PNorm = 486.3887, GNorm = 0.6531, lr_0 = 9.9840e-04
Validation auc = 0.703886
Epoch 2726
Loss = 8.7592e-03, PNorm = 486.4518, GNorm = 0.5180, lr_0 = 9.9840e-04
Validation auc = 0.701464
Epoch 2727
Loss = 6.2710e-02, PNorm = 486.5177, GNorm = 0.0195, lr_0 = 9.9840e-04
Validation auc = 0.689134
Epoch 2728
Loss = 4.2625e-02, PNorm = 486.5963, GNorm = 1.2364, lr_0 = 9.9840e-04
Validation auc = 0.687156
Epoch 2729
Loss = 1.7486e-02, PNorm = 486.7303, GNorm = 0.5929, lr_0 = 9.9839e-04
Loss = 2.6777e-02, PNorm = 486.8430, GNorm = 0.9903, lr_0 = 9.9839e-04
Validation auc = 0.701412
Epoch 2730
Loss = 3.5639e-02, PNorm = 486.9149, GNorm = 2.2136, lr_0 = 9.9839e-04
Validation auc = 0.710519
Epoch 2731
Loss = 5.0968e-02, PNorm = 486.9810, GNorm = 3.2680, lr_0 = 9.9839e-04
Validation auc = 0.694452
Epoch 2732
Loss = 1.1040e-02, PNorm = 487.0629, GNorm = 0.0708, lr_0 = 9.9839e-04
Validation auc = 0.691231
Epoch 2733
Loss = 4.5657e-02, PNorm = 487.1459, GNorm = 0.8366, lr_0 = 9.9839e-04
Validation auc = 0.705405
Epoch 2734
Loss = 1.1143e-01, PNorm = 487.2416, GNorm = 0.1384, lr_0 = 9.9839e-04
Validation auc = 0.705281
Epoch 2735
Loss = 2.9173e-02, PNorm = 487.3302, GNorm = 0.2932, lr_0 = 9.9839e-04
Validation auc = 0.709693
Epoch 2736
Loss = 5.8758e-02, PNorm = 487.4246, GNorm = 1.2059, lr_0 = 9.9839e-04
Validation auc = 0.700907
Epoch 2737
Loss = 8.3849e-02, PNorm = 487.5246, GNorm = 3.1306, lr_0 = 9.9839e-04
Validation auc = 0.704972
Epoch 2738
Loss = 1.2462e-01, PNorm = 487.6133, GNorm = 0.2566, lr_0 = 9.9839e-04
Validation auc = 0.695112
Epoch 2739
Loss = 2.6327e-02, PNorm = 487.7068, GNorm = 0.6329, lr_0 = 9.9839e-04
Loss = 3.6131e-02, PNorm = 487.8061, GNorm = 0.1969, lr_0 = 9.9839e-04
Validation auc = 0.708518
Epoch 2740
Loss = 4.8553e-02, PNorm = 487.9043, GNorm = 5.8578, lr_0 = 9.9839e-04
Validation auc = 0.720363
Epoch 2741
Loss = 5.5730e-02, PNorm = 488.0093, GNorm = 0.5380, lr_0 = 9.9839e-04
Validation auc = 0.713366
Epoch 2742
Loss = 7.3420e-03, PNorm = 488.1046, GNorm = 0.0905, lr_0 = 9.9838e-04
Validation auc = 0.719064
Epoch 2743
Loss = 6.4585e-02, PNorm = 488.1789, GNorm = 0.9398, lr_0 = 9.9838e-04
Validation auc = 0.721428
Epoch 2744
Loss = 5.9540e-02, PNorm = 488.2762, GNorm = 2.5729, lr_0 = 9.9838e-04
Validation auc = 0.722974
Epoch 2745
Loss = 1.9703e-02, PNorm = 488.3789, GNorm = 0.8281, lr_0 = 9.9838e-04
Validation auc = 0.723453
Epoch 2746
Loss = 2.6428e-02, PNorm = 488.4504, GNorm = 1.4336, lr_0 = 9.9838e-04
Validation auc = 0.720103
Epoch 2747
Loss = 1.8154e-02, PNorm = 488.5151, GNorm = 0.8331, lr_0 = 9.9838e-04
Validation auc = 0.720607
Epoch 2748
Loss = 2.9072e-02, PNorm = 488.5748, GNorm = 0.6832, lr_0 = 9.9838e-04
Validation auc = 0.732011
Epoch 2749
Loss = 2.7702e-02, PNorm = 488.6366, GNorm = 1.0126, lr_0 = 9.9838e-04
Loss = 6.7500e-02, PNorm = 488.7229, GNorm = 0.0125, lr_0 = 9.9838e-04
Validation auc = 0.720080
Epoch 2750
Loss = 6.7242e-02, PNorm = 488.8408, GNorm = 0.1269, lr_0 = 9.9838e-04
Validation auc = 0.707085
Epoch 2751
Loss = 8.9886e-02, PNorm = 488.9852, GNorm = 0.2629, lr_0 = 9.9838e-04
Validation auc = 0.716580
Epoch 2752
Loss = 5.5421e-02, PNorm = 489.1186, GNorm = 0.2338, lr_0 = 9.9838e-04
Validation auc = 0.723974
Epoch 2753
Loss = 6.6700e-02, PNorm = 489.2291, GNorm = 1.0064, lr_0 = 9.9838e-04
Validation auc = 0.709792
Epoch 2754
Loss = 6.4796e-02, PNorm = 489.3615, GNorm = 3.2257, lr_0 = 9.9838e-04
Validation auc = 0.710411
Epoch 2755
Loss = 4.8193e-02, PNorm = 489.4707, GNorm = 5.3416, lr_0 = 9.9838e-04
Validation auc = 0.719816
Epoch 2756
Loss = 4.2050e-02, PNorm = 489.5824, GNorm = 1.1660, lr_0 = 9.9837e-04
Validation auc = 0.719149
Epoch 2757
Loss = 1.0277e-01, PNorm = 489.7175, GNorm = 1.0377, lr_0 = 9.9837e-04
Validation auc = 0.715623
Epoch 2758
Loss = 4.9544e-02, PNorm = 489.9175, GNorm = 3.0797, lr_0 = 9.9837e-04
Validation auc = 0.709391
Epoch 2759
Loss = 5.4418e-02, PNorm = 490.0605, GNorm = 3.2852, lr_0 = 9.9837e-04
Loss = 9.1176e-02, PNorm = 490.1952, GNorm = 0.3896, lr_0 = 9.9837e-04
Validation auc = 0.704555
Epoch 2760
Loss = 6.2463e-02, PNorm = 490.3461, GNorm = 0.5689, lr_0 = 9.9837e-04
Validation auc = 0.703309
Epoch 2761
Loss = 1.5017e-01, PNorm = 490.4960, GNorm = 1.9550, lr_0 = 9.9837e-04
Validation auc = 0.703290
Epoch 2762
Loss = 9.5499e-02, PNorm = 490.6531, GNorm = 1.1016, lr_0 = 9.9837e-04
Validation auc = 0.702307
Epoch 2763
Loss = 8.2401e-02, PNorm = 490.8032, GNorm = 1.4444, lr_0 = 9.9837e-04
Validation auc = 0.692610
Epoch 2764
Loss = 1.7402e-01, PNorm = 490.9269, GNorm = 3.7380, lr_0 = 9.9837e-04
Validation auc = 0.685619
Epoch 2765
Loss = 4.3964e-02, PNorm = 491.0316, GNorm = 0.5023, lr_0 = 9.9837e-04
Validation auc = 0.684154
Epoch 2766
Loss = 6.1880e-02, PNorm = 491.1308, GNorm = 3.6450, lr_0 = 9.9837e-04
Validation auc = 0.692597
Epoch 2767
Loss = 1.4234e-01, PNorm = 491.2408, GNorm = 0.6497, lr_0 = 9.9837e-04
Validation auc = 0.705730
Epoch 2768
Loss = 3.2868e-02, PNorm = 491.3505, GNorm = 1.6108, lr_0 = 9.9837e-04
Validation auc = 0.712489
Epoch 2769
Loss = 2.9413e-02, PNorm = 491.4476, GNorm = 0.7575, lr_0 = 9.9836e-04
Loss = 1.4061e-01, PNorm = 491.5557, GNorm = 4.2917, lr_0 = 9.9836e-04
Validation auc = 0.721465
Epoch 2770
Loss = 8.2546e-02, PNorm = 491.6923, GNorm = 1.0613, lr_0 = 9.9836e-04
Validation auc = 0.720240
Epoch 2771
Loss = 6.4911e-02, PNorm = 491.8088, GNorm = 2.9251, lr_0 = 9.9836e-04
Validation auc = 0.725430
Epoch 2772
Loss = 6.1793e-02, PNorm = 491.9006, GNorm = 0.5080, lr_0 = 9.9836e-04
Validation auc = 0.719882
Epoch 2773
Loss = 1.6165e-02, PNorm = 491.9896, GNorm = 1.2017, lr_0 = 9.9836e-04
Validation auc = 0.717506
Epoch 2774
Loss = 4.2142e-02, PNorm = 492.0587, GNorm = 0.5981, lr_0 = 9.9836e-04
Validation auc = 0.716205
Epoch 2775
Loss = 8.5665e-02, PNorm = 492.1436, GNorm = 1.2198, lr_0 = 9.9836e-04
Validation auc = 0.714224
Epoch 2776
Loss = 1.3168e-01, PNorm = 492.2283, GNorm = 5.4110, lr_0 = 9.9836e-04
Validation auc = 0.730216
Epoch 2777
Loss = 3.1170e-02, PNorm = 492.3414, GNorm = 1.7653, lr_0 = 9.9836e-04
Validation auc = 0.728729
Epoch 2778
Loss = 2.2431e-02, PNorm = 492.4255, GNorm = 1.1800, lr_0 = 9.9836e-04
Validation auc = 0.722818
Epoch 2779
Loss = 1.0614e-02, PNorm = 492.4937, GNorm = 2.6452, lr_0 = 9.9836e-04
Loss = 5.6860e-02, PNorm = 492.5547, GNorm = 1.6901, lr_0 = 9.9836e-04
Validation auc = 0.715729
Epoch 2780
Loss = 2.1969e-02, PNorm = 492.6075, GNorm = 0.6612, lr_0 = 9.9836e-04
Validation auc = 0.712274
Epoch 2781
Loss = 7.6518e-02, PNorm = 492.6523, GNorm = 1.9256, lr_0 = 9.9836e-04
Validation auc = 0.714837
Epoch 2782
Loss = 1.7899e-02, PNorm = 492.7146, GNorm = 0.3498, lr_0 = 9.9835e-04
Validation auc = 0.717025
Epoch 2783
Loss = 4.2794e-02, PNorm = 492.7623, GNorm = 2.4813, lr_0 = 9.9835e-04
Validation auc = 0.714296
Epoch 2784
Loss = 6.7235e-02, PNorm = 492.8146, GNorm = 6.2625, lr_0 = 9.9835e-04
Validation auc = 0.700006
Epoch 2785
Loss = 3.6547e-02, PNorm = 492.8925, GNorm = 0.3602, lr_0 = 9.9835e-04
Validation auc = 0.697342
Epoch 2786
Loss = 3.1910e-02, PNorm = 492.9599, GNorm = 0.9408, lr_0 = 9.9835e-04
Validation auc = 0.701803
Epoch 2787
Loss = 8.0069e-02, PNorm = 493.0214, GNorm = 0.1260, lr_0 = 9.9835e-04
Validation auc = 0.707257
Epoch 2788
Loss = 7.9530e-02, PNorm = 493.0840, GNorm = 2.8918, lr_0 = 9.9835e-04
Validation auc = 0.709542
Epoch 2789
Loss = 2.1654e+00, PNorm = 493.1527, GNorm = 36.2203, lr_0 = 9.9835e-04
Loss = 5.2986e-02, PNorm = 493.2839, GNorm = 3.5354, lr_0 = 9.9835e-04
Validation auc = 0.726403
Epoch 2790
Loss = 8.4223e-02, PNorm = 493.4006, GNorm = 0.3386, lr_0 = 9.9835e-04
Validation auc = 0.735294
Epoch 2791
Loss = 1.0005e-01, PNorm = 493.5070, GNorm = 0.2202, lr_0 = 9.9835e-04
Validation auc = 0.728376
Epoch 2792
Loss = 1.0039e-01, PNorm = 493.6269, GNorm = 7.9110, lr_0 = 9.9835e-04
Validation auc = 0.718388
Epoch 2793
Loss = 8.7989e-02, PNorm = 493.7384, GNorm = 3.9749, lr_0 = 9.9835e-04
Validation auc = 0.720941
Epoch 2794
Loss = 2.9846e-02, PNorm = 493.8353, GNorm = 0.2409, lr_0 = 9.9835e-04
Validation auc = 0.727049
Epoch 2795
Loss = 5.0496e-02, PNorm = 493.9062, GNorm = 1.1808, lr_0 = 9.9834e-04
Validation auc = 0.731724
Epoch 2796
Loss = 1.3676e-01, PNorm = 493.9820, GNorm = 0.5620, lr_0 = 9.9834e-04
Validation auc = 0.727128
Epoch 2797
Loss = 2.0265e-02, PNorm = 494.0580, GNorm = 3.8256, lr_0 = 9.9834e-04
Validation auc = 0.721460
Epoch 2798
Loss = 2.5315e-01, PNorm = 494.1462, GNorm = 3.8372, lr_0 = 9.9834e-04
Validation auc = 0.717708
Epoch 2799
Loss = 1.0831e-01, PNorm = 494.2338, GNorm = 1.5454, lr_0 = 9.9834e-04
Loss = 4.3646e-02, PNorm = 494.2991, GNorm = 3.1029, lr_0 = 9.9834e-04
Validation auc = 0.714146
Epoch 2800
Loss = 2.9049e-02, PNorm = 494.3625, GNorm = 0.3367, lr_0 = 9.9834e-04
Validation auc = 0.705721
Epoch 2801
Loss = 3.8932e-02, PNorm = 494.4134, GNorm = 0.9382, lr_0 = 9.9834e-04
Validation auc = 0.704352
Epoch 2802
Loss = 6.5059e-02, PNorm = 494.4622, GNorm = 0.1367, lr_0 = 9.9834e-04
Validation auc = 0.704918
Epoch 2803
Loss = 2.1775e-02, PNorm = 494.5138, GNorm = 0.2772, lr_0 = 9.9834e-04
Validation auc = 0.708616
Epoch 2804
Loss = 2.7533e-02, PNorm = 494.5578, GNorm = 0.0730, lr_0 = 9.9834e-04
Validation auc = 0.694823
Epoch 2805
Loss = 9.6978e-02, PNorm = 494.6065, GNorm = 1.5658, lr_0 = 9.9834e-04
Validation auc = 0.692366
Epoch 2806
Loss = 7.4993e-02, PNorm = 494.6655, GNorm = 3.3397, lr_0 = 9.9834e-04
Validation auc = 0.684613
Epoch 2807
Loss = 1.2265e-01, PNorm = 494.7349, GNorm = 0.1622, lr_0 = 9.9834e-04
Validation auc = 0.687699
Epoch 2808
Loss = 6.9831e-03, PNorm = 494.7960, GNorm = 0.2252, lr_0 = 9.9834e-04
Validation auc = 0.692474
Epoch 2809
Loss = 2.4520e-03, PNorm = 494.8437, GNorm = 0.1800, lr_0 = 9.9833e-04
Loss = 3.6349e-02, PNorm = 494.8797, GNorm = 0.5949, lr_0 = 9.9833e-04
Validation auc = 0.699059
Epoch 2810
Loss = 3.9608e-02, PNorm = 494.9237, GNorm = 0.9034, lr_0 = 9.9833e-04
Validation auc = 0.695519
Epoch 2811
Loss = 1.5620e-02, PNorm = 494.9767, GNorm = 1.3683, lr_0 = 9.9833e-04
Validation auc = 0.692600
Epoch 2812
Loss = 3.8637e-02, PNorm = 495.0338, GNorm = 0.3066, lr_0 = 9.9833e-04
Validation auc = 0.685548
Epoch 2813
Loss = 4.1699e-02, PNorm = 495.1107, GNorm = 0.2553, lr_0 = 9.9833e-04
Validation auc = 0.687106
Epoch 2814
Loss = 9.8601e-02, PNorm = 495.1971, GNorm = 1.1460, lr_0 = 9.9833e-04
Validation auc = 0.701047
Epoch 2815
Loss = 1.2910e-02, PNorm = 495.2963, GNorm = 0.6994, lr_0 = 9.9833e-04
Validation auc = 0.706880
Epoch 2816
Loss = 1.8815e-02, PNorm = 495.3711, GNorm = 0.7054, lr_0 = 9.9833e-04
Validation auc = 0.699188
Epoch 2817
Loss = 2.8416e-02, PNorm = 495.4594, GNorm = 0.3285, lr_0 = 9.9833e-04
Validation auc = 0.692975
Epoch 2818
Loss = 7.6612e-03, PNorm = 495.5536, GNorm = 0.2321, lr_0 = 9.9833e-04
Validation auc = 0.706125
Epoch 2819
Loss = 3.3593e-02, PNorm = 495.6331, GNorm = 2.4726, lr_0 = 9.9833e-04
Loss = 6.5691e-02, PNorm = 495.7278, GNorm = 0.5594, lr_0 = 9.9833e-04
Validation auc = 0.730933
Epoch 2820
Loss = 3.6081e-02, PNorm = 495.8105, GNorm = 2.9865, lr_0 = 9.9833e-04
Validation auc = 0.742195
Epoch 2821
Loss = 1.3182e-02, PNorm = 495.8716, GNorm = 0.8856, lr_0 = 9.9832e-04
Validation auc = 0.739790
Epoch 2822
Loss = 5.5578e-03, PNorm = 495.9223, GNorm = 0.0834, lr_0 = 9.9832e-04
Validation auc = 0.730120
Epoch 2823
Loss = 6.7732e-02, PNorm = 495.9762, GNorm = 0.1899, lr_0 = 9.9832e-04
Validation auc = 0.724696
Epoch 2824
Loss = 1.0530e-01, PNorm = 496.0501, GNorm = 0.7244, lr_0 = 9.9832e-04
Validation auc = 0.732157
Epoch 2825
Loss = 5.2716e-02, PNorm = 496.1295, GNorm = 0.7939, lr_0 = 9.9832e-04
Validation auc = 0.734947
Epoch 2826
Loss = 1.4499e-02, PNorm = 496.1963, GNorm = 0.4968, lr_0 = 9.9832e-04
Validation auc = 0.734935
Epoch 2827
Loss = 5.5909e-02, PNorm = 496.2472, GNorm = 1.1296, lr_0 = 9.9832e-04
Validation auc = 0.726852
Epoch 2828
Loss = 1.3798e-02, PNorm = 496.2932, GNorm = 0.8029, lr_0 = 9.9832e-04
Validation auc = 0.718794
Epoch 2829
Loss = 4.7540e-02, PNorm = 496.3449, GNorm = 2.1415, lr_0 = 9.9832e-04
Loss = 4.3823e-02, PNorm = 496.4129, GNorm = 1.2067, lr_0 = 9.9832e-04
Validation auc = 0.733327
Epoch 2830
Loss = 3.4302e-02, PNorm = 496.4695, GNorm = 0.1918, lr_0 = 9.9832e-04
Validation auc = 0.736287
Epoch 2831
Loss = 7.9668e-02, PNorm = 496.5357, GNorm = 4.9519, lr_0 = 9.9832e-04
Validation auc = 0.730285
Epoch 2832
Loss = 9.5453e-03, PNorm = 496.6073, GNorm = 0.1438, lr_0 = 9.9832e-04
Validation auc = 0.731917
Epoch 2833
Loss = 5.5331e-02, PNorm = 496.6633, GNorm = 0.5788, lr_0 = 9.9832e-04
Validation auc = 0.722761
Epoch 2834
Loss = 4.1425e-02, PNorm = 496.7159, GNorm = 3.5257, lr_0 = 9.9832e-04
Validation auc = 0.716000
Epoch 2835
Loss = 7.9224e-02, PNorm = 496.7850, GNorm = 0.7126, lr_0 = 9.9831e-04
Validation auc = 0.721651
Epoch 2836
Loss = 2.4199e-02, PNorm = 496.8609, GNorm = 0.6854, lr_0 = 9.9831e-04
Validation auc = 0.731858
Epoch 2837
Loss = 1.1433e-02, PNorm = 496.9300, GNorm = 0.6727, lr_0 = 9.9831e-04
Validation auc = 0.748964
Epoch 2838
Loss = 5.2632e-02, PNorm = 497.0192, GNorm = 3.1867, lr_0 = 9.9831e-04
Validation auc = 0.745850
Epoch 2839
Loss = 2.7855e-03, PNorm = 497.1007, GNorm = 0.1319, lr_0 = 9.9831e-04
Loss = 3.7120e-02, PNorm = 497.1613, GNorm = 1.6281, lr_0 = 9.9831e-04
Validation auc = 0.745078
Epoch 2840
Loss = 2.0416e-02, PNorm = 497.2199, GNorm = 0.0209, lr_0 = 9.9831e-04
Validation auc = 0.737813
Epoch 2841
Loss = 2.9158e-02, PNorm = 497.2636, GNorm = 1.5401, lr_0 = 9.9831e-04
Validation auc = 0.737856
Epoch 2842
Loss = 3.3198e-02, PNorm = 497.3010, GNorm = 2.4301, lr_0 = 9.9831e-04
Validation auc = 0.736197
Epoch 2843
Loss = 1.5811e-02, PNorm = 497.3410, GNorm = 2.5535, lr_0 = 9.9831e-04
Validation auc = 0.738359
Epoch 2844
Loss = 7.1840e-02, PNorm = 497.3794, GNorm = 2.2134, lr_0 = 9.9831e-04
Validation auc = 0.717543
Epoch 2845
Loss = 1.4577e-02, PNorm = 497.4464, GNorm = 0.6641, lr_0 = 9.9831e-04
Validation auc = 0.698857
Epoch 2846
Loss = 1.0014e-01, PNorm = 497.5208, GNorm = 8.9488, lr_0 = 9.9831e-04
Validation auc = 0.694008
Epoch 2847
Loss = 1.5221e-02, PNorm = 497.6061, GNorm = 0.5950, lr_0 = 9.9831e-04
Validation auc = 0.707586
Epoch 2848
Loss = 6.6078e-02, PNorm = 497.7064, GNorm = 1.3213, lr_0 = 9.9830e-04
Validation auc = 0.708173
Epoch 2849
Loss = 1.5534e-02, PNorm = 497.7994, GNorm = 0.4840, lr_0 = 9.9830e-04
Loss = 2.6338e-02, PNorm = 497.8692, GNorm = 3.3808, lr_0 = 9.9830e-04
Validation auc = 0.713243
Epoch 2850
Loss = 4.4034e-02, PNorm = 497.9295, GNorm = 0.1981, lr_0 = 9.9830e-04
Validation auc = 0.718645
Epoch 2851
Loss = 4.4353e-02, PNorm = 497.9971, GNorm = 3.3183, lr_0 = 9.9830e-04
Validation auc = 0.725756
Epoch 2852
Loss = 2.6841e-02, PNorm = 498.0911, GNorm = 1.3759, lr_0 = 9.9830e-04
Validation auc = 0.726629
Epoch 2853
Loss = 1.5703e-02, PNorm = 498.1663, GNorm = 1.7165, lr_0 = 9.9830e-04
Validation auc = 0.724322
Epoch 2854
Loss = 1.8709e-02, PNorm = 498.2228, GNorm = 0.8847, lr_0 = 9.9830e-04
Validation auc = 0.726138
Epoch 2855
Loss = 8.3832e-02, PNorm = 498.2704, GNorm = 3.2827, lr_0 = 9.9830e-04
Validation auc = 0.721677
Epoch 2856
Loss = 1.9184e-02, PNorm = 498.3166, GNorm = 2.5524, lr_0 = 9.9830e-04
Validation auc = 0.720274
Epoch 2857
Loss = 1.6112e-02, PNorm = 498.3698, GNorm = 0.5863, lr_0 = 9.9830e-04
Validation auc = 0.714045
Epoch 2858
Loss = 1.0153e-01, PNorm = 498.4314, GNorm = 3.3575, lr_0 = 9.9830e-04
Validation auc = 0.719472
Epoch 2859
Loss = 3.3849e-02, PNorm = 498.4869, GNorm = 1.8422, lr_0 = 9.9830e-04
Loss = 3.9923e-02, PNorm = 498.5397, GNorm = 2.0957, lr_0 = 9.9830e-04
Validation auc = 0.731056
Epoch 2860
Loss = 6.3279e-02, PNorm = 498.6118, GNorm = 0.3048, lr_0 = 9.9830e-04
Validation auc = 0.738680
Epoch 2861
Loss = 3.1643e-02, PNorm = 498.6894, GNorm = 2.5115, lr_0 = 9.9829e-04
Validation auc = 0.742614
Epoch 2862
Loss = 4.8665e-02, PNorm = 498.7581, GNorm = 4.7714, lr_0 = 9.9829e-04
Validation auc = 0.743921
Epoch 2863
Loss = 4.3033e-02, PNorm = 498.8169, GNorm = 0.3065, lr_0 = 9.9829e-04
Validation auc = 0.741410
Epoch 2864
Loss = 9.0076e-03, PNorm = 498.8757, GNorm = 0.2075, lr_0 = 9.9829e-04
Validation auc = 0.740161
Epoch 2865
Loss = 1.5520e-02, PNorm = 498.9176, GNorm = 1.7226, lr_0 = 9.9829e-04
Validation auc = 0.742102
Epoch 2866
Loss = 1.8835e-01, PNorm = 498.9603, GNorm = 2.2439, lr_0 = 9.9829e-04
Validation auc = 0.742269
Epoch 2867
Loss = 9.4959e-02, PNorm = 499.0441, GNorm = 8.6843, lr_0 = 9.9829e-04
Validation auc = 0.718599
Epoch 2868
Loss = 5.8871e-02, PNorm = 499.1544, GNorm = 1.0965, lr_0 = 9.9829e-04
Validation auc = 0.703109
Epoch 2869
Loss = 3.3865e-01, PNorm = 499.2782, GNorm = 6.0171, lr_0 = 9.9829e-04
Loss = 6.2008e-02, PNorm = 499.4385, GNorm = 4.0801, lr_0 = 9.9829e-04
Validation auc = 0.689887
Epoch 2870
Loss = 6.2654e-02, PNorm = 499.5754, GNorm = 1.8142, lr_0 = 9.9829e-04
Validation auc = 0.704470
Epoch 2871
Loss = 3.9362e-02, PNorm = 499.6976, GNorm = 0.5392, lr_0 = 9.9829e-04
Validation auc = 0.713761
Epoch 2872
Loss = 1.2095e-01, PNorm = 499.8119, GNorm = 2.1376, lr_0 = 9.9829e-04
Validation auc = 0.703180
Epoch 2873
Loss = 2.8767e-02, PNorm = 499.9310, GNorm = 0.5467, lr_0 = 9.9829e-04
Validation auc = 0.711336
Epoch 2874
Loss = 3.6842e-02, PNorm = 500.0162, GNorm = 2.0264, lr_0 = 9.9828e-04
Validation auc = 0.719877
Epoch 2875
Loss = 2.4263e-02, PNorm = 500.1021, GNorm = 0.6606, lr_0 = 9.9828e-04
Validation auc = 0.713515
Epoch 2876
Loss = 1.3127e-01, PNorm = 500.1860, GNorm = 0.9280, lr_0 = 9.9828e-04
Validation auc = 0.712295
Epoch 2877
Loss = 1.3639e-02, PNorm = 500.2742, GNorm = 0.2658, lr_0 = 9.9828e-04
Validation auc = 0.710248
Epoch 2878
Loss = 7.5265e-02, PNorm = 500.3587, GNorm = 2.1814, lr_0 = 9.9828e-04
Validation auc = 0.711129
Epoch 2879
Loss = 5.3208e-03, PNorm = 500.4518, GNorm = 0.1977, lr_0 = 9.9828e-04
Loss = 2.4181e-02, PNorm = 500.5148, GNorm = 2.6869, lr_0 = 9.9828e-04
Validation auc = 0.710568
Epoch 2880
Loss = 3.2284e-02, PNorm = 500.5629, GNorm = 4.2761, lr_0 = 9.9828e-04
Validation auc = 0.707774
Epoch 2881
Loss = 7.0875e-02, PNorm = 500.6293, GNorm = 3.0093, lr_0 = 9.9828e-04
Validation auc = 0.696221
Epoch 2882
Loss = 4.6595e-02, PNorm = 500.7129, GNorm = 2.4143, lr_0 = 9.9828e-04
Validation auc = 0.697403
Epoch 2883
Loss = 1.2211e-02, PNorm = 500.7849, GNorm = 0.2011, lr_0 = 9.9828e-04
Validation auc = 0.714908
Epoch 2884
Loss = 4.3328e-02, PNorm = 500.8490, GNorm = 1.5662, lr_0 = 9.9828e-04
Validation auc = 0.724955
Epoch 2885
Loss = 5.6018e-02, PNorm = 500.9144, GNorm = 0.3580, lr_0 = 9.9828e-04
Validation auc = 0.725425
Epoch 2886
Loss = 9.7807e-03, PNorm = 500.9886, GNorm = 0.1068, lr_0 = 9.9828e-04
Validation auc = 0.715478
Epoch 2887
Loss = 2.4102e-02, PNorm = 501.0735, GNorm = 0.7990, lr_0 = 9.9828e-04
Validation auc = 0.719077
Epoch 2888
Loss = 7.4247e-02, PNorm = 501.1637, GNorm = 4.1154, lr_0 = 9.9827e-04
Validation auc = 0.724154
Epoch 2889
Loss = 3.8407e-02, PNorm = 501.2604, GNorm = 1.3017, lr_0 = 9.9827e-04
Loss = 7.0474e-02, PNorm = 501.3686, GNorm = 0.4860, lr_0 = 9.9827e-04
Validation auc = 0.729927
Epoch 2890
Loss = 3.4324e-02, PNorm = 501.4532, GNorm = 0.8218, lr_0 = 9.9827e-04
Validation auc = 0.724922
Epoch 2891
Loss = 1.1381e-02, PNorm = 501.5107, GNorm = 1.6020, lr_0 = 9.9827e-04
Validation auc = 0.725352
Epoch 2892
Loss = 2.0436e-02, PNorm = 501.5595, GNorm = 0.9203, lr_0 = 9.9827e-04
Validation auc = 0.734531
Epoch 2893
Loss = 5.3381e-02, PNorm = 501.6025, GNorm = 3.0237, lr_0 = 9.9827e-04
Validation auc = 0.732720
Epoch 2894
Loss = 5.8159e-02, PNorm = 501.6681, GNorm = 0.7682, lr_0 = 9.9827e-04
Validation auc = 0.728631
Epoch 2895
Loss = 4.2354e-02, PNorm = 501.7722, GNorm = 1.9574, lr_0 = 9.9827e-04
Validation auc = 0.721022
Epoch 2896
Loss = 9.9371e-02, PNorm = 501.8662, GNorm = 2.0905, lr_0 = 9.9827e-04
Validation auc = 0.716526
Epoch 2897
Loss = 7.2894e-02, PNorm = 501.9665, GNorm = 3.6426, lr_0 = 9.9827e-04
Validation auc = 0.717178
Epoch 2898
Loss = 3.2721e-02, PNorm = 502.0578, GNorm = 0.5274, lr_0 = 9.9827e-04
Validation auc = 0.707772
Epoch 2899
Loss = 9.1095e-02, PNorm = 502.1385, GNorm = 1.7569, lr_0 = 9.9827e-04
Loss = 4.8942e-02, PNorm = 502.2282, GNorm = 2.3394, lr_0 = 9.9827e-04
Validation auc = 0.704585
Epoch 2900
Loss = 4.5086e-02, PNorm = 502.3019, GNorm = 3.1207, lr_0 = 9.9827e-04
Validation auc = 0.711828
Epoch 2901
Loss = 4.1276e-02, PNorm = 502.3664, GNorm = 1.6182, lr_0 = 9.9826e-04
Validation auc = 0.717438
Epoch 2902
Loss = 3.8855e-02, PNorm = 502.4254, GNorm = 0.3988, lr_0 = 9.9826e-04
Validation auc = 0.711946
Epoch 2903
Loss = 2.0796e-02, PNorm = 502.4860, GNorm = 0.2093, lr_0 = 9.9826e-04
Validation auc = 0.707240
Epoch 2904
Loss = 7.3273e-02, PNorm = 502.5424, GNorm = 2.5089, lr_0 = 9.9826e-04
Validation auc = 0.709532
Epoch 2905
Loss = 1.2314e-01, PNorm = 502.6111, GNorm = 8.1394, lr_0 = 9.9826e-04
Validation auc = 0.725322
Epoch 2906
Loss = 7.5434e-02, PNorm = 502.7108, GNorm = 3.0903, lr_0 = 9.9826e-04
Validation auc = 0.731248
Epoch 2907
Loss = 3.1511e-02, PNorm = 502.8089, GNorm = 1.2305, lr_0 = 9.9826e-04
Validation auc = 0.726915
Epoch 2908
Loss = 9.7078e-03, PNorm = 502.8801, GNorm = 0.2046, lr_0 = 9.9826e-04
Validation auc = 0.720065
Epoch 2909
Loss = 5.6264e-02, PNorm = 502.9269, GNorm = 2.1664, lr_0 = 9.9826e-04
Loss = 4.8783e-02, PNorm = 502.9691, GNorm = 2.5437, lr_0 = 9.9826e-04
Validation auc = 0.712933
Epoch 2910
Loss = 4.4642e-02, PNorm = 503.0218, GNorm = 0.5406, lr_0 = 9.9826e-04
Validation auc = 0.711487
Epoch 2911
Loss = 2.9327e-02, PNorm = 503.0885, GNorm = 0.8130, lr_0 = 9.9826e-04
Validation auc = 0.711438
Epoch 2912
Loss = 1.1002e-02, PNorm = 503.1470, GNorm = 0.8212, lr_0 = 9.9826e-04
Validation auc = 0.707663
Epoch 2913
Loss = 7.3970e-02, PNorm = 503.2001, GNorm = 4.5222, lr_0 = 9.9826e-04
Validation auc = 0.709202
Epoch 2914
Loss = 2.6772e-02, PNorm = 503.2590, GNorm = 0.2841, lr_0 = 9.9825e-04
Validation auc = 0.715873
Epoch 2915
Loss = 8.3486e-02, PNorm = 503.3413, GNorm = 0.2205, lr_0 = 9.9825e-04
Validation auc = 0.711301
Epoch 2916
Loss = 6.3202e-02, PNorm = 503.4365, GNorm = 1.7668, lr_0 = 9.9825e-04
Validation auc = 0.718971
Epoch 2917
Loss = 9.3021e-02, PNorm = 503.5324, GNorm = 1.8593, lr_0 = 9.9825e-04
Validation auc = 0.709719
Epoch 2918
Loss = 1.1583e-01, PNorm = 503.6204, GNorm = 0.7011, lr_0 = 9.9825e-04
Validation auc = 0.715238
Epoch 2919
Loss = 4.3765e-02, PNorm = 503.7074, GNorm = 1.5715, lr_0 = 9.9825e-04
Loss = 6.0742e-02, PNorm = 503.8033, GNorm = 0.3777, lr_0 = 9.9825e-04
Validation auc = 0.716323
Epoch 2920
Loss = 4.4479e-02, PNorm = 503.8908, GNorm = 8.1509, lr_0 = 9.9825e-04
Validation auc = 0.726570
Epoch 2921
Loss = 7.7976e-02, PNorm = 503.9805, GNorm = 0.4555, lr_0 = 9.9825e-04
Validation auc = 0.703233
Epoch 2922
Loss = 6.7919e-02, PNorm = 504.0925, GNorm = 1.7006, lr_0 = 9.9825e-04
Validation auc = 0.689477
Epoch 2923
Loss = 5.2959e-02, PNorm = 504.2127, GNorm = 0.6768, lr_0 = 9.9825e-04
Validation auc = 0.693061
Epoch 2924
Loss = 1.5039e-01, PNorm = 504.3179, GNorm = 5.8859, lr_0 = 9.9825e-04
Validation auc = 0.696861
Epoch 2925
Loss = 2.3862e-02, PNorm = 504.4344, GNorm = 1.4983, lr_0 = 9.9825e-04
Validation auc = 0.705316
Epoch 2926
Loss = 9.6489e-03, PNorm = 504.5190, GNorm = 0.3603, lr_0 = 9.9825e-04
Validation auc = 0.712109
Epoch 2927
Loss = 7.4101e-03, PNorm = 504.5761, GNorm = 0.3756, lr_0 = 9.9825e-04
Validation auc = 0.712525
Epoch 2928
Loss = 3.3985e-02, PNorm = 504.6193, GNorm = 0.2068, lr_0 = 9.9824e-04
Validation auc = 0.709856
Epoch 2929
Loss = 5.4830e-02, PNorm = 504.6769, GNorm = 1.5212, lr_0 = 9.9824e-04
Loss = 4.8655e-02, PNorm = 504.7510, GNorm = 1.0482, lr_0 = 9.9824e-04
Validation auc = 0.702773
Epoch 2930
Loss = 2.8320e-02, PNorm = 504.8282, GNorm = 0.9718, lr_0 = 9.9824e-04
Validation auc = 0.705774
Epoch 2931
Loss = 5.8212e-02, PNorm = 504.9053, GNorm = 0.6018, lr_0 = 9.9824e-04
Validation auc = 0.702072
Epoch 2932
Loss = 8.1973e-02, PNorm = 504.9867, GNorm = 3.2338, lr_0 = 9.9824e-04
Validation auc = 0.698587
Epoch 2933
Loss = 5.4250e-02, PNorm = 505.0868, GNorm = 0.8615, lr_0 = 9.9824e-04
Validation auc = 0.700416
Epoch 2934
Loss = 3.7860e-02, PNorm = 505.1720, GNorm = 1.3795, lr_0 = 9.9824e-04
Validation auc = 0.704151
Epoch 2935
Loss = 1.6826e-01, PNorm = 505.2337, GNorm = 2.6443, lr_0 = 9.9824e-04
Validation auc = 0.695833
Epoch 2936
Loss = 6.5416e-02, PNorm = 505.3141, GNorm = 0.7890, lr_0 = 9.9824e-04
Validation auc = 0.691311
Epoch 2937
Loss = 1.7115e-02, PNorm = 505.3905, GNorm = 1.0905, lr_0 = 9.9824e-04
Validation auc = 0.698590
Epoch 2938
Loss = 3.7365e-02, PNorm = 505.4559, GNorm = 2.0402, lr_0 = 9.9824e-04
Validation auc = 0.708148
Epoch 2939
Loss = 2.8507e-03, PNorm = 505.5128, GNorm = 0.2127, lr_0 = 9.9824e-04
Loss = 1.9343e-02, PNorm = 505.5683, GNorm = 0.6951, lr_0 = 9.9824e-04
Validation auc = 0.710200
Epoch 2940
Loss = 8.6840e-02, PNorm = 505.6305, GNorm = 2.5023, lr_0 = 9.9823e-04
Validation auc = 0.699548
Epoch 2941
Loss = 9.2245e-02, PNorm = 505.7251, GNorm = 2.5718, lr_0 = 9.9823e-04
Validation auc = 0.682637
Epoch 2942
Loss = 3.4403e-02, PNorm = 505.8145, GNorm = 1.7499, lr_0 = 9.9823e-04
Validation auc = 0.686298
Epoch 2943
Loss = 3.0707e-02, PNorm = 505.8841, GNorm = 1.4808, lr_0 = 9.9823e-04
Validation auc = 0.692912
Epoch 2944
Loss = 1.2826e-02, PNorm = 505.9359, GNorm = 0.0527, lr_0 = 9.9823e-04
Validation auc = 0.700691
Epoch 2945
Loss = 4.1487e-02, PNorm = 505.9795, GNorm = 0.3771, lr_0 = 9.9823e-04
Validation auc = 0.714356
Epoch 2946
Loss = 9.5450e-03, PNorm = 506.0465, GNorm = 2.1873, lr_0 = 9.9823e-04
Validation auc = 0.715462
Epoch 2947
Loss = 1.0612e-02, PNorm = 506.1055, GNorm = 0.7555, lr_0 = 9.9823e-04
Validation auc = 0.715197
Epoch 2948
Loss = 1.4776e-02, PNorm = 506.1707, GNorm = 1.0004, lr_0 = 9.9823e-04
Validation auc = 0.715309
Epoch 2949
Loss = 2.0526e-01, PNorm = 506.2345, GNorm = 5.1104, lr_0 = 9.9823e-04
Loss = 7.5578e-02, PNorm = 506.3152, GNorm = 0.0496, lr_0 = 9.9823e-04
Validation auc = 0.712470
Epoch 2950
Loss = 3.2084e-02, PNorm = 506.3875, GNorm = 0.1375, lr_0 = 9.9823e-04
Validation auc = 0.702992
Epoch 2951
Loss = 4.7684e-02, PNorm = 506.4497, GNorm = 3.6973, lr_0 = 9.9823e-04
Validation auc = 0.699836
Epoch 2952
Loss = 2.4093e-02, PNorm = 506.5250, GNorm = 1.4295, lr_0 = 9.9823e-04
Validation auc = 0.716509
Epoch 2953
Loss = 3.9450e-02, PNorm = 506.5982, GNorm = 0.4869, lr_0 = 9.9823e-04
Validation auc = 0.721047
Epoch 2954
Loss = 2.9723e-02, PNorm = 506.6676, GNorm = 0.9526, lr_0 = 9.9822e-04
Validation auc = 0.729408
Epoch 2955
Loss = 2.7666e-02, PNorm = 506.7450, GNorm = 2.1724, lr_0 = 9.9822e-04
Validation auc = 0.730446
Epoch 2956
Loss = 1.1438e-02, PNorm = 506.8324, GNorm = 0.0618, lr_0 = 9.9822e-04
Validation auc = 0.729347
Epoch 2957
Loss = 1.6698e-02, PNorm = 506.9205, GNorm = 0.9060, lr_0 = 9.9822e-04
Validation auc = 0.730817
Epoch 2958
Loss = 1.5831e-01, PNorm = 507.0019, GNorm = 5.5925, lr_0 = 9.9822e-04
Validation auc = 0.721906
Epoch 2959
Loss = 3.1824e-03, PNorm = 507.0872, GNorm = 0.1182, lr_0 = 9.9822e-04
Loss = 3.4812e-02, PNorm = 507.1665, GNorm = 1.7815, lr_0 = 9.9822e-04
Validation auc = 0.710626
Epoch 2960
Loss = 3.8196e-02, PNorm = 507.2406, GNorm = 1.0772, lr_0 = 9.9822e-04
Validation auc = 0.703737
Epoch 2961
Loss = 1.4299e-02, PNorm = 507.3241, GNorm = 0.3942, lr_0 = 9.9822e-04
Validation auc = 0.708755
Epoch 2962
Loss = 3.4869e-02, PNorm = 507.3822, GNorm = 3.6676, lr_0 = 9.9822e-04
Validation auc = 0.716652
Epoch 2963
Loss = 7.4241e-02, PNorm = 507.4376, GNorm = 3.8092, lr_0 = 9.9822e-04
Validation auc = 0.717431
Epoch 2964
Loss = 6.9452e-02, PNorm = 507.4986, GNorm = 7.9368, lr_0 = 9.9822e-04
Validation auc = 0.706935
Epoch 2965
Loss = 3.0078e-02, PNorm = 507.5793, GNorm = 0.8672, lr_0 = 9.9822e-04
Validation auc = 0.708084
Epoch 2966
Loss = 4.5113e-02, PNorm = 507.6683, GNorm = 1.1628, lr_0 = 9.9822e-04
Validation auc = 0.705889
Epoch 2967
Loss = 2.7369e-02, PNorm = 507.7498, GNorm = 0.6931, lr_0 = 9.9821e-04
Validation auc = 0.709959
Epoch 2968
Loss = 3.7652e-03, PNorm = 507.8122, GNorm = 0.3001, lr_0 = 9.9821e-04
Validation auc = 0.708982
Epoch 2969
Loss = 9.9648e-02, PNorm = 507.8575, GNorm = 3.0231, lr_0 = 9.9821e-04
Loss = 7.1276e-02, PNorm = 507.9139, GNorm = 3.9638, lr_0 = 9.9821e-04
Validation auc = 0.707475
Epoch 2970
Loss = 4.6556e-02, PNorm = 507.9721, GNorm = 6.8211, lr_0 = 9.9821e-04
Validation auc = 0.701038
Epoch 2971
Loss = 6.4474e-02, PNorm = 508.0407, GNorm = 1.2600, lr_0 = 9.9821e-04
Validation auc = 0.680166
Epoch 2972
Loss = 7.8389e-02, PNorm = 508.1311, GNorm = 1.1774, lr_0 = 9.9821e-04
Validation auc = 0.671664
Epoch 2973
Loss = 3.8937e-02, PNorm = 508.2130, GNorm = 1.6982, lr_0 = 9.9821e-04
Validation auc = 0.674106
Epoch 2974
Loss = 1.7819e-02, PNorm = 508.2764, GNorm = 1.8329, lr_0 = 9.9821e-04
Validation auc = 0.681658
Epoch 2975
Loss = 3.9911e-02, PNorm = 508.3286, GNorm = 2.5693, lr_0 = 9.9821e-04
Validation auc = 0.698752
Epoch 2976
Loss = 2.0123e-02, PNorm = 508.3866, GNorm = 1.7928, lr_0 = 9.9821e-04
Validation auc = 0.714121
Epoch 2977
Loss = 9.0163e-03, PNorm = 508.4487, GNorm = 0.6396, lr_0 = 9.9821e-04
Validation auc = 0.712976
Epoch 2978
Loss = 4.7465e-02, PNorm = 508.5040, GNorm = 0.0994, lr_0 = 9.9821e-04
Validation auc = 0.706572
Epoch 2979
Loss = 3.8852e-04, PNorm = 508.5619, GNorm = 0.0237, lr_0 = 9.9821e-04
Loss = 6.0591e-02, PNorm = 508.6323, GNorm = 8.7476, lr_0 = 9.9821e-04
Validation auc = 0.708885
Epoch 2980
Loss = 1.6326e-02, PNorm = 508.7164, GNorm = 2.1555, lr_0 = 9.9820e-04
Validation auc = 0.722695
Epoch 2981
Loss = 5.9345e-02, PNorm = 508.8014, GNorm = 3.1950, lr_0 = 9.9820e-04
Validation auc = 0.730658
Epoch 2982
Loss = 4.6691e-02, PNorm = 508.8953, GNorm = 1.7771, lr_0 = 9.9820e-04
Validation auc = 0.725913
Epoch 2983
Loss = 3.9801e-02, PNorm = 508.9805, GNorm = 0.7344, lr_0 = 9.9820e-04
Validation auc = 0.729681
Epoch 2984
Loss = 5.6549e-02, PNorm = 509.0621, GNorm = 3.9894, lr_0 = 9.9820e-04
Validation auc = 0.727340
Epoch 2985
Loss = 2.3942e-01, PNorm = 509.1695, GNorm = 3.5272, lr_0 = 9.9820e-04
Validation auc = 0.722290
Epoch 2986
Loss = 5.9360e-02, PNorm = 509.3274, GNorm = 4.1616, lr_0 = 9.9820e-04
Validation auc = 0.718930
Epoch 2987
Loss = 2.4084e-02, PNorm = 509.4703, GNorm = 0.6702, lr_0 = 9.9820e-04
Validation auc = 0.715091
Epoch 2988
Loss = 7.8155e-03, PNorm = 509.5911, GNorm = 0.2220, lr_0 = 9.9820e-04
Validation auc = 0.711968
Epoch 2989
Loss = 4.2894e-03, PNorm = 509.6774, GNorm = 0.2475, lr_0 = 9.9820e-04
Loss = 7.9428e-02, PNorm = 509.7564, GNorm = 6.1542, lr_0 = 9.9820e-04
Validation auc = 0.716735
Epoch 2990
Loss = 8.4890e-02, PNorm = 509.8539, GNorm = 0.3665, lr_0 = 9.9820e-04
Validation auc = 0.720367
Epoch 2991
Loss = 3.9081e-02, PNorm = 509.9523, GNorm = 0.7904, lr_0 = 9.9820e-04
Validation auc = 0.712058
Epoch 2992
Loss = 2.5132e-02, PNorm = 510.0207, GNorm = 0.7983, lr_0 = 9.9820e-04
Validation auc = 0.707495
Epoch 2993
Loss = 3.1751e-02, PNorm = 510.1055, GNorm = 0.3594, lr_0 = 9.9819e-04
Validation auc = 0.712680
Epoch 2994
Loss = 8.2184e-02, PNorm = 510.2022, GNorm = 0.2755, lr_0 = 9.9819e-04
Validation auc = 0.709305
Epoch 2995
Loss = 2.7567e-02, PNorm = 510.2869, GNorm = 0.7994, lr_0 = 9.9819e-04
Validation auc = 0.706786
Epoch 2996
Loss = 2.0901e-02, PNorm = 510.3544, GNorm = 1.3706, lr_0 = 9.9819e-04
Validation auc = 0.703662
Epoch 2997
Loss = 3.7543e-02, PNorm = 510.4118, GNorm = 1.2183, lr_0 = 9.9819e-04
Validation auc = 0.695872
Epoch 2998
Loss = 1.2685e-02, PNorm = 510.4767, GNorm = 0.5409, lr_0 = 9.9819e-04
Validation auc = 0.694581
Epoch 2999
Loss = 4.5715e-02, PNorm = 510.5412, GNorm = 2.1698, lr_0 = 9.9819e-04
Loss = 2.4945e-02, PNorm = 510.5995, GNorm = 1.5803, lr_0 = 9.9819e-04
Validation auc = 0.713771
Epoch 3000
Loss = 7.2377e-02, PNorm = 510.6654, GNorm = 2.2438, lr_0 = 9.9819e-04
Validation auc = 0.723385
Epoch 3001
Loss = 4.3385e-02, PNorm = 510.7257, GNorm = 1.7048, lr_0 = 9.9819e-04
Validation auc = 0.729913
Epoch 3002
Loss = 2.8258e-02, PNorm = 510.7901, GNorm = 1.1206, lr_0 = 9.9819e-04
Validation auc = 0.731520
Epoch 3003
Loss = 3.4379e-02, PNorm = 510.8538, GNorm = 0.9561, lr_0 = 9.9819e-04
Validation auc = 0.719330
Epoch 3004
Loss = 3.0001e-02, PNorm = 510.9069, GNorm = 0.2443, lr_0 = 9.9819e-04
Validation auc = 0.718619
Epoch 3005
Loss = 1.0953e-01, PNorm = 510.9643, GNorm = 0.3282, lr_0 = 9.9819e-04
Validation auc = 0.722041
Epoch 3006
Loss = 3.0839e-02, PNorm = 511.0483, GNorm = 1.1225, lr_0 = 9.9819e-04
Validation auc = 0.714498
Epoch 3007
Loss = 2.0890e-02, PNorm = 511.1393, GNorm = 3.4503, lr_0 = 9.9818e-04
Validation auc = 0.704346
Epoch 3008
Loss = 2.9317e-02, PNorm = 511.2163, GNorm = 0.5305, lr_0 = 9.9818e-04
Validation auc = 0.698341
Epoch 3009
Loss = 2.1960e-02, PNorm = 511.3003, GNorm = 0.7813, lr_0 = 9.9818e-04
Loss = 6.4157e-02, PNorm = 511.3973, GNorm = 4.1979, lr_0 = 9.9818e-04
Validation auc = 0.695774
Epoch 3010
Loss = 5.0505e-02, PNorm = 511.4854, GNorm = 0.6039, lr_0 = 9.9818e-04
Validation auc = 0.696157
Epoch 3011
Loss = 6.6296e-02, PNorm = 511.5660, GNorm = 5.1350, lr_0 = 9.9818e-04
Validation auc = 0.696203
Epoch 3012
Loss = 9.4653e-02, PNorm = 511.6537, GNorm = 6.2564, lr_0 = 9.9818e-04
Validation auc = 0.708825
Epoch 3013
Loss = 2.0848e-02, PNorm = 511.7491, GNorm = 0.5418, lr_0 = 9.9818e-04
Validation auc = 0.713088
Epoch 3014
Loss = 3.8855e-02, PNorm = 511.8233, GNorm = 0.3560, lr_0 = 9.9818e-04
Validation auc = 0.716084
Epoch 3015
Loss = 6.9514e-02, PNorm = 511.8833, GNorm = 0.3510, lr_0 = 9.9818e-04
Validation auc = 0.715506
Epoch 3016
Loss = 6.0210e-02, PNorm = 511.9615, GNorm = 1.9289, lr_0 = 9.9818e-04
Validation auc = 0.698598
Epoch 3017
Loss = 2.9065e-02, PNorm = 512.0461, GNorm = 0.8810, lr_0 = 9.9818e-04
Validation auc = 0.685426
Epoch 3018
Loss = 8.5817e-03, PNorm = 512.1417, GNorm = 0.2858, lr_0 = 9.9818e-04
Validation auc = 0.676053
Epoch 3019
Loss = 1.0346e-03, PNorm = 512.2315, GNorm = 0.0645, lr_0 = 9.9818e-04
Loss = 3.3755e-02, PNorm = 512.3000, GNorm = 0.3370, lr_0 = 9.9817e-04
Validation auc = 0.681354
Epoch 3020
Loss = 3.9515e-02, PNorm = 512.3733, GNorm = 0.5555, lr_0 = 9.9817e-04
Validation auc = 0.689908
Epoch 3021
Loss = 3.9797e-02, PNorm = 512.4441, GNorm = 1.9655, lr_0 = 9.9817e-04
Validation auc = 0.695749
Epoch 3022
Loss = 3.5608e-02, PNorm = 512.5207, GNorm = 1.3247, lr_0 = 9.9817e-04
Validation auc = 0.695266
Epoch 3023
Loss = 5.3873e-02, PNorm = 512.6151, GNorm = 0.6142, lr_0 = 9.9817e-04
Validation auc = 0.708395
Epoch 3024
Loss = 6.4033e-02, PNorm = 512.7130, GNorm = 3.0042, lr_0 = 9.9817e-04
Validation auc = 0.724749
Epoch 3025
Loss = 7.3071e-02, PNorm = 512.8126, GNorm = 4.9034, lr_0 = 9.9817e-04
Validation auc = 0.736504
Epoch 3026
Loss = 1.2290e-02, PNorm = 512.9067, GNorm = 0.1926, lr_0 = 9.9817e-04
Validation auc = 0.736871
Epoch 3027
Loss = 2.0848e-02, PNorm = 512.9815, GNorm = 1.0581, lr_0 = 9.9817e-04
Validation auc = 0.738475
Epoch 3028
Loss = 4.4596e-02, PNorm = 513.0308, GNorm = 2.8311, lr_0 = 9.9817e-04
Validation auc = 0.733533
Epoch 3029
Loss = 3.2805e-02, PNorm = 513.0972, GNorm = 1.8631, lr_0 = 9.9817e-04
Loss = 3.6177e-02, PNorm = 513.1894, GNorm = 0.6371, lr_0 = 9.9817e-04
Validation auc = 0.735133
Epoch 3030
Loss = 1.4788e-01, PNorm = 513.2854, GNorm = 1.6125, lr_0 = 9.9817e-04
Validation auc = 0.732266
Epoch 3031
Loss = 9.1113e-02, PNorm = 513.3902, GNorm = 2.6244, lr_0 = 9.9817e-04
Validation auc = 0.720793
Epoch 3032
Loss = 2.8569e-02, PNorm = 513.4816, GNorm = 0.4179, lr_0 = 9.9817e-04
Validation auc = 0.716747
Epoch 3033
Loss = 1.6408e-02, PNorm = 513.5516, GNorm = 0.4384, lr_0 = 9.9816e-04
Validation auc = 0.717616
Epoch 3034
Loss = 1.1230e-02, PNorm = 513.6059, GNorm = 0.6427, lr_0 = 9.9816e-04
Validation auc = 0.720345
Epoch 3035
Loss = 2.1892e-02, PNorm = 513.6652, GNorm = 0.6118, lr_0 = 9.9816e-04
Validation auc = 0.726508
Epoch 3036
Loss = 3.0266e-02, PNorm = 513.7260, GNorm = 0.4961, lr_0 = 9.9816e-04
Validation auc = 0.734341
Epoch 3037
Loss = 4.0601e-02, PNorm = 513.8060, GNorm = 0.4859, lr_0 = 9.9816e-04
Validation auc = 0.732485
Epoch 3038
Loss = 4.0548e-03, PNorm = 513.8948, GNorm = 0.5584, lr_0 = 9.9816e-04
Validation auc = 0.727637
Epoch 3039
Loss = 2.8575e-02, PNorm = 513.9735, GNorm = 1.3969, lr_0 = 9.9816e-04
Loss = 7.5196e-02, PNorm = 514.0633, GNorm = 3.3752, lr_0 = 9.9816e-04
Validation auc = 0.733967
Epoch 3040
Loss = 3.0761e-02, PNorm = 514.1511, GNorm = 0.0938, lr_0 = 9.9816e-04
Validation auc = 0.733342
Epoch 3041
Loss = 4.6378e-02, PNorm = 514.2327, GNorm = 1.0555, lr_0 = 9.9816e-04
Validation auc = 0.736962
Epoch 3042
Loss = 1.5486e-02, PNorm = 514.3132, GNorm = 0.1783, lr_0 = 9.9816e-04
Validation auc = 0.730306
Epoch 3043
Loss = 7.6783e-02, PNorm = 514.3877, GNorm = 3.3553, lr_0 = 9.9816e-04
Validation auc = 0.715121
Epoch 3044
Loss = 3.1897e-02, PNorm = 514.5012, GNorm = 1.7414, lr_0 = 9.9816e-04
Validation auc = 0.694152
Epoch 3045
Loss = 3.3208e-02, PNorm = 514.6159, GNorm = 0.4870, lr_0 = 9.9816e-04
Validation auc = 0.703807
Epoch 3046
Loss = 3.4795e-02, PNorm = 514.7003, GNorm = 1.8841, lr_0 = 9.9816e-04
Validation auc = 0.714945
Epoch 3047
Loss = 1.1475e-01, PNorm = 514.7671, GNorm = 0.3874, lr_0 = 9.9815e-04
Validation auc = 0.727685
Epoch 3048
Loss = 1.3261e-02, PNorm = 514.8477, GNorm = 0.3074, lr_0 = 9.9815e-04
Validation auc = 0.731363
Epoch 3049
Loss = 5.8345e-02, PNorm = 514.9035, GNorm = 1.9468, lr_0 = 9.9815e-04
Loss = 9.0814e-02, PNorm = 514.9577, GNorm = 1.9134, lr_0 = 9.9815e-04
Validation auc = 0.732607
Epoch 3050
Loss = 6.0168e-02, PNorm = 515.0309, GNorm = 1.6855, lr_0 = 9.9815e-04
Validation auc = 0.727077
Epoch 3051
Loss = 7.4686e-02, PNorm = 515.0984, GNorm = 0.8366, lr_0 = 9.9815e-04
Validation auc = 0.725192
Epoch 3052
Loss = 2.7434e-02, PNorm = 515.1617, GNorm = 0.5270, lr_0 = 9.9815e-04
Validation auc = 0.724846
Epoch 3053
Loss = 1.9732e-02, PNorm = 515.2250, GNorm = 1.2209, lr_0 = 9.9815e-04
Validation auc = 0.722790
Epoch 3054
Loss = 1.3361e-02, PNorm = 515.2782, GNorm = 0.4211, lr_0 = 9.9815e-04
Validation auc = 0.721404
Epoch 3055
Loss = 6.9318e-02, PNorm = 515.3221, GNorm = 3.4865, lr_0 = 9.9815e-04
Validation auc = 0.721166
Epoch 3056
Loss = 7.7969e-03, PNorm = 515.3892, GNorm = 0.6338, lr_0 = 9.9815e-04
Validation auc = 0.721860
Epoch 3057
Loss = 1.3871e-01, PNorm = 515.4698, GNorm = 3.9078, lr_0 = 9.9815e-04
Validation auc = 0.712243
Epoch 3058
Loss = 2.8889e-02, PNorm = 515.5784, GNorm = 1.9591, lr_0 = 9.9815e-04
Validation auc = 0.708639
Epoch 3059
Loss = 1.0048e-02, PNorm = 515.6841, GNorm = 0.5227, lr_0 = 9.9815e-04
Loss = 3.5950e-02, PNorm = 515.7704, GNorm = 1.0835, lr_0 = 9.9814e-04
Validation auc = 0.708287
Epoch 3060
Loss = 3.1612e-02, PNorm = 515.8456, GNorm = 1.6302, lr_0 = 9.9814e-04
Validation auc = 0.710580
Epoch 3061
Loss = 4.0116e-02, PNorm = 515.9048, GNorm = 1.1914, lr_0 = 9.9814e-04
Validation auc = 0.711872
Epoch 3062
Loss = 2.8553e-02, PNorm = 515.9761, GNorm = 4.2764, lr_0 = 9.9814e-04
Validation auc = 0.711506
Epoch 3063
Loss = 5.7999e-02, PNorm = 516.0516, GNorm = 5.2090, lr_0 = 9.9814e-04
Validation auc = 0.705864
Epoch 3064
Loss = 3.0321e-02, PNorm = 516.1349, GNorm = 2.5495, lr_0 = 9.9814e-04
Validation auc = 0.703268
Epoch 3065
Loss = 1.7583e-01, PNorm = 516.2215, GNorm = 0.2911, lr_0 = 9.9814e-04
Validation auc = 0.711773
Epoch 3066
Loss = 7.0769e-02, PNorm = 516.3301, GNorm = 4.7591, lr_0 = 9.9814e-04
Validation auc = 0.698337
Epoch 3067
Loss = 1.0181e-01, PNorm = 516.4345, GNorm = 0.9328, lr_0 = 9.9814e-04
Validation auc = 0.699538
Epoch 3068
Loss = 1.2553e-02, PNorm = 516.5391, GNorm = 1.2230, lr_0 = 9.9814e-04
Validation auc = 0.701216
Epoch 3069
Loss = 1.1969e-03, PNorm = 516.6292, GNorm = 0.0587, lr_0 = 9.9814e-04
Loss = 4.8586e-02, PNorm = 516.6971, GNorm = 0.5956, lr_0 = 9.9814e-04
Validation auc = 0.694843
Epoch 3070
Loss = 2.5541e-02, PNorm = 516.7449, GNorm = 0.1840, lr_0 = 9.9814e-04
Validation auc = 0.691101
Epoch 3071
Loss = 1.0054e-02, PNorm = 516.7807, GNorm = 1.1975, lr_0 = 9.9814e-04
Validation auc = 0.692025
Epoch 3072
Loss = 6.2016e-02, PNorm = 516.8322, GNorm = 4.7250, lr_0 = 9.9814e-04
Validation auc = 0.694217
Epoch 3073
Loss = 3.0245e-02, PNorm = 516.9026, GNorm = 0.3193, lr_0 = 9.9813e-04
Validation auc = 0.701414
Epoch 3074
Loss = 1.7876e-02, PNorm = 516.9575, GNorm = 0.9652, lr_0 = 9.9813e-04
Validation auc = 0.706878
Epoch 3075
Loss = 6.8392e-02, PNorm = 517.0127, GNorm = 0.7108, lr_0 = 9.9813e-04
Validation auc = 0.712132
Epoch 3076
Loss = 4.1062e-02, PNorm = 517.0778, GNorm = 2.8468, lr_0 = 9.9813e-04
Validation auc = 0.710327
Epoch 3077
Loss = 9.0337e-02, PNorm = 517.1369, GNorm = 6.4761, lr_0 = 9.9813e-04
Validation auc = 0.715182
Epoch 3078
Loss = 8.6635e-02, PNorm = 517.1955, GNorm = 2.9702, lr_0 = 9.9813e-04
Validation auc = 0.717323
Epoch 3079
Loss = 7.2267e-02, PNorm = 517.2502, GNorm = 1.9287, lr_0 = 9.9813e-04
Loss = 4.1048e-02, PNorm = 517.2972, GNorm = 0.2727, lr_0 = 9.9813e-04
Validation auc = 0.715387
Epoch 3080
Loss = 1.8419e-02, PNorm = 517.3435, GNorm = 0.1950, lr_0 = 9.9813e-04
Validation auc = 0.714158
Epoch 3081
Loss = 5.0920e-02, PNorm = 517.3878, GNorm = 1.3984, lr_0 = 9.9813e-04
Validation auc = 0.711895
Epoch 3082
Loss = 8.1002e-02, PNorm = 517.4448, GNorm = 0.4504, lr_0 = 9.9813e-04
Validation auc = 0.713531
Epoch 3083
Loss = 7.2670e-02, PNorm = 517.5240, GNorm = 1.0507, lr_0 = 9.9813e-04
Validation auc = 0.713461
Epoch 3084
Loss = 2.6780e-02, PNorm = 517.6108, GNorm = 3.2394, lr_0 = 9.9813e-04
Validation auc = 0.724296
Epoch 3085
Loss = 2.5996e-02, PNorm = 517.6771, GNorm = 0.0330, lr_0 = 9.9813e-04
Validation auc = 0.733562
Epoch 3086
Loss = 8.2542e-02, PNorm = 517.7295, GNorm = 3.9060, lr_0 = 9.9812e-04
Validation auc = 0.719114
Epoch 3087
Loss = 2.9549e-03, PNorm = 517.8175, GNorm = 0.0841, lr_0 = 9.9812e-04
Validation auc = 0.715203
Epoch 3088
Loss = 1.8255e-02, PNorm = 517.9031, GNorm = 0.4401, lr_0 = 9.9812e-04
Validation auc = 0.710872
Epoch 3089
Loss = 6.8641e-03, PNorm = 517.9767, GNorm = 0.5838, lr_0 = 9.9812e-04
Loss = 6.9595e-02, PNorm = 518.0452, GNorm = 3.4787, lr_0 = 9.9812e-04
Validation auc = 0.702732
Epoch 3090
Loss = 9.9730e-02, PNorm = 518.1464, GNorm = 1.1110, lr_0 = 9.9812e-04
Validation auc = 0.701559
Epoch 3091
Loss = 1.0987e-01, PNorm = 518.2997, GNorm = 2.8383, lr_0 = 9.9812e-04
Validation auc = 0.697503
Epoch 3092
Loss = 8.9899e-02, PNorm = 518.4486, GNorm = 1.1991, lr_0 = 9.9812e-04
Validation auc = 0.689283
Epoch 3093
Loss = 5.9130e-02, PNorm = 518.5855, GNorm = 1.6344, lr_0 = 9.9812e-04
Validation auc = 0.685982
Epoch 3094
Loss = 5.0861e-02, PNorm = 518.6940, GNorm = 1.4769, lr_0 = 9.9812e-04
Validation auc = 0.688305
Epoch 3095
Loss = 2.2537e-02, PNorm = 518.7972, GNorm = 1.7471, lr_0 = 9.9812e-04
Validation auc = 0.690245
Epoch 3096
Loss = 3.6178e-02, PNorm = 518.8816, GNorm = 1.9369, lr_0 = 9.9812e-04
Validation auc = 0.691822
Epoch 3097
Loss = 3.9093e-02, PNorm = 518.9549, GNorm = 0.0585, lr_0 = 9.9812e-04
Validation auc = 0.699031
Epoch 3098
Loss = 6.3714e-02, PNorm = 519.0251, GNorm = 2.1414, lr_0 = 9.9812e-04
Validation auc = 0.701951
Epoch 3099
Loss = 1.1308e-02, PNorm = 519.0959, GNorm = 0.8001, lr_0 = 9.9812e-04
Loss = 1.9328e-01, PNorm = 519.1958, GNorm = 3.5434, lr_0 = 9.9811e-04
Validation auc = 0.698703
Epoch 3100
Loss = 5.8192e-02, PNorm = 519.2920, GNorm = 3.9436, lr_0 = 9.9811e-04
Validation auc = 0.696902
Epoch 3101
Loss = 9.5938e-02, PNorm = 519.3767, GNorm = 2.1249, lr_0 = 9.9811e-04
Validation auc = 0.695932
Epoch 3102
Loss = 6.8482e-02, PNorm = 519.4578, GNorm = 0.3873, lr_0 = 9.9811e-04
Validation auc = 0.708206
Epoch 3103
Loss = 3.7095e-02, PNorm = 519.5296, GNorm = 0.7004, lr_0 = 9.9811e-04
Validation auc = 0.717198
Epoch 3104
Loss = 4.2654e-02, PNorm = 519.5869, GNorm = 3.8952, lr_0 = 9.9811e-04
Validation auc = 0.731584
Epoch 3105
Loss = 4.7508e-02, PNorm = 519.6559, GNorm = 1.3909, lr_0 = 9.9811e-04
Validation auc = 0.726887
Epoch 3106
Loss = 8.8605e-02, PNorm = 519.7305, GNorm = 2.9995, lr_0 = 9.9811e-04
Validation auc = 0.722763
Epoch 3107
Loss = 9.4442e-02, PNorm = 519.8141, GNorm = 1.6351, lr_0 = 9.9811e-04
Validation auc = 0.728942
Epoch 3108
Loss = 7.4618e-03, PNorm = 519.9067, GNorm = 0.1989, lr_0 = 9.9811e-04
Validation auc = 0.731367
Epoch 3109
Loss = 1.2018e-02, PNorm = 519.9826, GNorm = 1.4390, lr_0 = 9.9811e-04
Loss = 8.0627e-02, PNorm = 520.0686, GNorm = 1.9554, lr_0 = 9.9811e-04
Validation auc = 0.727303
Epoch 3110
Loss = 9.9347e-02, PNorm = 520.1545, GNorm = 4.4751, lr_0 = 9.9811e-04
Validation auc = 0.726697
Epoch 3111
Loss = 6.1896e-02, PNorm = 520.2674, GNorm = 1.4062, lr_0 = 9.9811e-04
Validation auc = 0.723358
Epoch 3112
Loss = 1.0734e-01, PNorm = 520.3987, GNorm = 1.9364, lr_0 = 9.9810e-04
Validation auc = 0.716273
Epoch 3113
Loss = 4.9986e-02, PNorm = 520.5142, GNorm = 0.3025, lr_0 = 9.9810e-04
Validation auc = 0.712398
Epoch 3114
Loss = 5.2631e-02, PNorm = 520.5968, GNorm = 2.2303, lr_0 = 9.9810e-04
Validation auc = 0.712121
Epoch 3115
Loss = 4.8455e-02, PNorm = 520.6633, GNorm = 0.6500, lr_0 = 9.9810e-04
Validation auc = 0.713329
Epoch 3116
Loss = 5.3079e-02, PNorm = 520.7178, GNorm = 0.2861, lr_0 = 9.9810e-04
Validation auc = 0.719300
Epoch 3117
Loss = 9.2239e-02, PNorm = 520.7595, GNorm = 3.4600, lr_0 = 9.9810e-04
Validation auc = 0.724913
Epoch 3118
Loss = 4.1680e-02, PNorm = 520.8024, GNorm = 3.0955, lr_0 = 9.9810e-04
Validation auc = 0.710337
Epoch 3119
Loss = 5.3625e-03, PNorm = 520.8885, GNorm = 0.1722, lr_0 = 9.9810e-04
Loss = 3.4473e-02, PNorm = 520.9803, GNorm = 0.1015, lr_0 = 9.9810e-04
Validation auc = 0.707149
Epoch 3120
Loss = 5.4169e-02, PNorm = 521.0462, GNorm = 2.2605, lr_0 = 9.9810e-04
Validation auc = 0.716531
Epoch 3121
Loss = 4.6779e-02, PNorm = 521.1231, GNorm = 0.3671, lr_0 = 9.9810e-04
Validation auc = 0.714243
Epoch 3122
Loss = 3.4296e-02, PNorm = 521.2012, GNorm = 0.3015, lr_0 = 9.9810e-04
Validation auc = 0.712713
Epoch 3123
Loss = 4.9182e-02, PNorm = 521.2758, GNorm = 1.4511, lr_0 = 9.9810e-04
Validation auc = 0.715118
Epoch 3124
Loss = 3.6136e-02, PNorm = 521.3588, GNorm = 0.5683, lr_0 = 9.9810e-04
Validation auc = 0.707683
Epoch 3125
Loss = 3.8833e-02, PNorm = 521.4459, GNorm = 1.4088, lr_0 = 9.9810e-04
Validation auc = 0.701291
Epoch 3126
Loss = 1.6516e-02, PNorm = 521.5229, GNorm = 0.5336, lr_0 = 9.9809e-04
Validation auc = 0.703492
Epoch 3127
Loss = 1.8399e-02, PNorm = 521.5825, GNorm = 0.1597, lr_0 = 9.9809e-04
Validation auc = 0.708780
Epoch 3128
Loss = 5.3920e-02, PNorm = 521.6362, GNorm = 0.0896, lr_0 = 9.9809e-04
Validation auc = 0.704900
Epoch 3129
Loss = 2.1245e-02, PNorm = 521.6934, GNorm = 0.7695, lr_0 = 9.9809e-04
Loss = 6.8950e-02, PNorm = 521.7780, GNorm = 4.6389, lr_0 = 9.9809e-04
Validation auc = 0.699689
Epoch 3130
Loss = 4.2320e-02, PNorm = 521.8701, GNorm = 0.4423, lr_0 = 9.9809e-04
Validation auc = 0.708142
Epoch 3131
Loss = 1.9668e-02, PNorm = 521.9393, GNorm = 0.1361, lr_0 = 9.9809e-04
Validation auc = 0.705450
Epoch 3132
Loss = 3.4060e-02, PNorm = 522.0100, GNorm = 2.9947, lr_0 = 9.9809e-04
Validation auc = 0.701252
Epoch 3133
Loss = 5.4010e-02, PNorm = 522.0782, GNorm = 0.1558, lr_0 = 9.9809e-04
Validation auc = 0.707603
Epoch 3134
Loss = 2.8234e-02, PNorm = 522.1370, GNorm = 0.7021, lr_0 = 9.9809e-04
Validation auc = 0.705301
Epoch 3135
Loss = 8.2445e-02, PNorm = 522.2220, GNorm = 0.5586, lr_0 = 9.9809e-04
Validation auc = 0.702950
Epoch 3136
Loss = 5.7448e-02, PNorm = 522.3085, GNorm = 0.3734, lr_0 = 9.9809e-04
Validation auc = 0.695882
Epoch 3137
Loss = 1.6599e-02, PNorm = 522.3885, GNorm = 0.3649, lr_0 = 9.9809e-04
Validation auc = 0.691109
Epoch 3138
Loss = 4.6048e-02, PNorm = 522.4758, GNorm = 0.3373, lr_0 = 9.9809e-04
Validation auc = 0.691027
Epoch 3139
Loss = 2.2747e-02, PNorm = 522.5898, GNorm = 1.2297, lr_0 = 9.9808e-04
Loss = 4.5889e-02, PNorm = 522.6806, GNorm = 5.0588, lr_0 = 9.9808e-04
Validation auc = 0.688630
Epoch 3140
Loss = 4.9745e-02, PNorm = 522.7618, GNorm = 1.7886, lr_0 = 9.9808e-04
Validation auc = 0.695930
Epoch 3141
Loss = 4.9264e-02, PNorm = 522.8422, GNorm = 5.2623, lr_0 = 9.9808e-04
Validation auc = 0.702216
Epoch 3142
Loss = 5.2434e-02, PNorm = 522.9336, GNorm = 2.6934, lr_0 = 9.9808e-04
Validation auc = 0.709366
Epoch 3143
Loss = 3.5680e-02, PNorm = 523.0402, GNorm = 0.4294, lr_0 = 9.9808e-04
Validation auc = 0.711239
Epoch 3144
Loss = 7.7312e-02, PNorm = 523.1358, GNorm = 0.5728, lr_0 = 9.9808e-04
Validation auc = 0.705861
Epoch 3145
Loss = 4.4737e-02, PNorm = 523.2296, GNorm = 2.9965, lr_0 = 9.9808e-04
Validation auc = 0.699877
Epoch 3146
Loss = 5.4123e-02, PNorm = 523.3083, GNorm = 2.2076, lr_0 = 9.9808e-04
Validation auc = 0.709718
Epoch 3147
Loss = 4.4076e-02, PNorm = 523.3907, GNorm = 0.0599, lr_0 = 9.9808e-04
Validation auc = 0.733494
Epoch 3148
Loss = 5.3372e-02, PNorm = 523.4823, GNorm = 1.9137, lr_0 = 9.9808e-04
Validation auc = 0.740139
Epoch 3149
Loss = 5.2559e-02, PNorm = 523.5741, GNorm = 2.4165, lr_0 = 9.9808e-04
Loss = 5.2511e-02, PNorm = 523.6877, GNorm = 1.4595, lr_0 = 9.9808e-04
Validation auc = 0.753430
Epoch 3150
Loss = 7.1649e-02, PNorm = 523.7811, GNorm = 3.6951, lr_0 = 9.9808e-04
Validation auc = 0.752925
Epoch 3151
Loss = 8.9227e-02, PNorm = 523.8601, GNorm = 5.9315, lr_0 = 9.9808e-04
Validation auc = 0.748122
Epoch 3152
Loss = 9.1740e-02, PNorm = 523.9803, GNorm = 5.6364, lr_0 = 9.9807e-04
Validation auc = 0.726451
Epoch 3153
Loss = 4.3222e-02, PNorm = 524.1000, GNorm = 0.9937, lr_0 = 9.9807e-04
Validation auc = 0.716287
Epoch 3154
Loss = 4.4274e-02, PNorm = 524.2026, GNorm = 3.0813, lr_0 = 9.9807e-04
Validation auc = 0.714873
Epoch 3155
Loss = 4.5740e-02, PNorm = 524.2965, GNorm = 1.0231, lr_0 = 9.9807e-04
Validation auc = 0.713777
Epoch 3156
Loss = 5.2645e-02, PNorm = 524.4011, GNorm = 3.7529, lr_0 = 9.9807e-04
Validation auc = 0.721424
Epoch 3157
Loss = 1.1097e-01, PNorm = 524.4938, GNorm = 1.5919, lr_0 = 9.9807e-04
Validation auc = 0.721518
Epoch 3158
Loss = 4.6151e-03, PNorm = 524.5742, GNorm = 0.1639, lr_0 = 9.9807e-04
Validation auc = 0.722848
Epoch 3159
Loss = 6.0309e-02, PNorm = 524.6467, GNorm = 1.9319, lr_0 = 9.9807e-04
Loss = 7.1389e-02, PNorm = 524.7146, GNorm = 5.8222, lr_0 = 9.9807e-04
Validation auc = 0.725711
Epoch 3160
Loss = 5.0348e-02, PNorm = 524.8017, GNorm = 1.4748, lr_0 = 9.9807e-04
Validation auc = 0.727105
Epoch 3161
Loss = 3.3725e-02, PNorm = 524.8719, GNorm = 2.7702, lr_0 = 9.9807e-04
Validation auc = 0.729744
Epoch 3162
Loss = 5.2879e-02, PNorm = 524.9386, GNorm = 1.3933, lr_0 = 9.9807e-04
Validation auc = 0.723821
Epoch 3163
Loss = 5.4652e-02, PNorm = 525.0207, GNorm = 5.2861, lr_0 = 9.9807e-04
Validation auc = 0.734435
Epoch 3164
Loss = 2.0225e-02, PNorm = 525.1087, GNorm = 0.0937, lr_0 = 9.9807e-04
Validation auc = 0.739371
Epoch 3165
Loss = 1.0584e-01, PNorm = 525.1761, GNorm = 1.6953, lr_0 = 9.9807e-04
Validation auc = 0.738183
Epoch 3166
Loss = 3.5177e-02, PNorm = 525.2427, GNorm = 2.6840, lr_0 = 9.9806e-04
Validation auc = 0.735076
Epoch 3167
Loss = 1.5272e-02, PNorm = 525.3158, GNorm = 0.9001, lr_0 = 9.9806e-04
Validation auc = 0.732419
Epoch 3168
Loss = 8.8339e-02, PNorm = 525.3820, GNorm = 2.8186, lr_0 = 9.9806e-04
Validation auc = 0.731680
Epoch 3169
Loss = 7.6004e-04, PNorm = 525.4516, GNorm = 0.0412, lr_0 = 9.9806e-04
Loss = 6.6323e-02, PNorm = 525.5199, GNorm = 0.9538, lr_0 = 9.9806e-04
Validation auc = 0.730230
Epoch 3170
Loss = 6.1838e-02, PNorm = 525.5950, GNorm = 6.1912, lr_0 = 9.9806e-04
Validation auc = 0.721247
Epoch 3171
Loss = 5.3321e-02, PNorm = 525.6833, GNorm = 1.0368, lr_0 = 9.9806e-04
Validation auc = 0.715678
Epoch 3172
Loss = 8.9126e-02, PNorm = 525.7611, GNorm = 0.3272, lr_0 = 9.9806e-04
Validation auc = 0.702797
Epoch 3173
Loss = 5.8305e-02, PNorm = 525.8421, GNorm = 1.4909, lr_0 = 9.9806e-04
Validation auc = 0.698647
Epoch 3174
Loss = 3.6504e-02, PNorm = 525.9106, GNorm = 1.2196, lr_0 = 9.9806e-04
Validation auc = 0.695972
Epoch 3175
Loss = 2.9068e-02, PNorm = 525.9721, GNorm = 0.1134, lr_0 = 9.9806e-04
Validation auc = 0.704826
Epoch 3176
Loss = 1.2654e-02, PNorm = 526.0231, GNorm = 0.5914, lr_0 = 9.9806e-04
Validation auc = 0.708087
Epoch 3177
Loss = 9.9519e-02, PNorm = 526.0669, GNorm = 4.2210, lr_0 = 9.9806e-04
Validation auc = 0.703409
Epoch 3178
Loss = 2.2806e-02, PNorm = 526.1291, GNorm = 1.9753, lr_0 = 9.9806e-04
Validation auc = 0.703726
Epoch 3179
Loss = 1.0593e-01, PNorm = 526.2005, GNorm = 2.3694, lr_0 = 9.9805e-04
Loss = 7.9888e-02, PNorm = 526.2818, GNorm = 7.9057, lr_0 = 9.9805e-04
Validation auc = 0.707616
Epoch 3180
Loss = 4.8860e-02, PNorm = 526.3857, GNorm = 1.6828, lr_0 = 9.9805e-04
Validation auc = 0.720186
Epoch 3181
Loss = 4.3207e-02, PNorm = 526.4749, GNorm = 0.2217, lr_0 = 9.9805e-04
Validation auc = 0.719440
Epoch 3182
Loss = 8.3715e-02, PNorm = 526.5790, GNorm = 1.3862, lr_0 = 9.9805e-04
Validation auc = 0.713834
Epoch 3183
Loss = 3.8389e-02, PNorm = 526.6873, GNorm = 6.7661, lr_0 = 9.9805e-04
Validation auc = 0.701359
Epoch 3184
Loss = 3.9014e-02, PNorm = 526.7686, GNorm = 1.5996, lr_0 = 9.9805e-04
Validation auc = 0.698123
Epoch 3185
Loss = 8.4352e-02, PNorm = 526.8331, GNorm = 0.8912, lr_0 = 9.9805e-04
Validation auc = 0.700789
Epoch 3186
Loss = 4.8319e-02, PNorm = 526.9063, GNorm = 1.7189, lr_0 = 9.9805e-04
Validation auc = 0.698952
Epoch 3187
Loss = 1.2384e-02, PNorm = 526.9691, GNorm = 0.8243, lr_0 = 9.9805e-04
Validation auc = 0.698206
Epoch 3188
Loss = 8.1492e-03, PNorm = 527.0147, GNorm = 1.3317, lr_0 = 9.9805e-04
Validation auc = 0.697509
Epoch 3189
Loss = 1.0654e-02, PNorm = 527.0532, GNorm = 1.0153, lr_0 = 9.9805e-04
Loss = 2.8086e-02, PNorm = 527.1007, GNorm = 1.2011, lr_0 = 9.9805e-04
Validation auc = 0.694473
Epoch 3190
Loss = 5.5312e-02, PNorm = 527.1533, GNorm = 3.5166, lr_0 = 9.9805e-04
Validation auc = 0.694565
Epoch 3191
Loss = 1.2186e-01, PNorm = 527.2264, GNorm = 4.7094, lr_0 = 9.9805e-04
Validation auc = 0.713346
Epoch 3192
Loss = 7.7907e-02, PNorm = 527.3067, GNorm = 2.8083, lr_0 = 9.9804e-04
Validation auc = 0.713350
Epoch 3193
Loss = 2.4963e-02, PNorm = 527.3749, GNorm = 0.4292, lr_0 = 9.9804e-04
Validation auc = 0.716171
Epoch 3194
Loss = 4.1021e-02, PNorm = 527.4264, GNorm = 0.2171, lr_0 = 9.9804e-04
Validation auc = 0.720384
Epoch 3195
Loss = 3.9680e-02, PNorm = 527.4764, GNorm = 1.5766, lr_0 = 9.9804e-04
Validation auc = 0.726000
Epoch 3196
Loss = 3.5104e-02, PNorm = 527.5238, GNorm = 0.3692, lr_0 = 9.9804e-04
Validation auc = 0.714213
Epoch 3197
Loss = 8.6688e-02, PNorm = 527.5714, GNorm = 0.0590, lr_0 = 9.9804e-04
Validation auc = 0.724680
Epoch 3198
Loss = 3.8522e-02, PNorm = 527.6374, GNorm = 2.1007, lr_0 = 9.9804e-04
Validation auc = 0.742421
Epoch 3199
Loss = 3.7787e-02, PNorm = 527.7514, GNorm = 1.2839, lr_0 = 9.9804e-04
Loss = 5.6327e-02, PNorm = 527.8648, GNorm = 0.5603, lr_0 = 9.9804e-04
Validation auc = 0.741237
Epoch 3200
Loss = 6.2235e-02, PNorm = 527.9564, GNorm = 2.8266, lr_0 = 9.9804e-04
Validation auc = 0.730867
Epoch 3201
Loss = 3.6284e-02, PNorm = 528.0487, GNorm = 0.0494, lr_0 = 9.9804e-04
Validation auc = 0.724579
Epoch 3202
Loss = 6.0686e-02, PNorm = 528.1250, GNorm = 1.4857, lr_0 = 9.9804e-04
Validation auc = 0.722680
Epoch 3203
Loss = 2.4686e-02, PNorm = 528.1960, GNorm = 3.0633, lr_0 = 9.9804e-04
Validation auc = 0.722195
Epoch 3204
Loss = 4.0887e-02, PNorm = 528.2714, GNorm = 7.9805, lr_0 = 9.9804e-04
Validation auc = 0.718727
Epoch 3205
Loss = 4.1736e-02, PNorm = 528.3506, GNorm = 2.3765, lr_0 = 9.9803e-04
Validation auc = 0.718892
Epoch 3206
Loss = 5.6773e-02, PNorm = 528.4249, GNorm = 3.4552, lr_0 = 9.9803e-04
Validation auc = 0.718399
Epoch 3207
Loss = 1.1254e-01, PNorm = 528.5310, GNorm = 2.7376, lr_0 = 9.9803e-04
Validation auc = 0.686084
Epoch 3208
Loss = 1.8647e-01, PNorm = 528.7314, GNorm = 10.3438, lr_0 = 9.9803e-04
Validation auc = 0.678391
Epoch 3209
Loss = 6.6740e-02, PNorm = 528.9349, GNorm = 2.0093, lr_0 = 9.9803e-04
Loss = 1.1288e-01, PNorm = 529.1189, GNorm = 4.3436, lr_0 = 9.9803e-04
Validation auc = 0.698767
Epoch 3210
Loss = 8.6841e-02, PNorm = 529.2789, GNorm = 1.9130, lr_0 = 9.9803e-04
Validation auc = 0.721449
Epoch 3211
Loss = 1.1683e-01, PNorm = 529.4336, GNorm = 2.8082, lr_0 = 9.9803e-04
Validation auc = 0.725303
Epoch 3212
Loss = 1.0959e-01, PNorm = 529.6053, GNorm = 2.4781, lr_0 = 9.9803e-04
Validation auc = 0.711400
Epoch 3213
Loss = 7.7009e-02, PNorm = 529.7672, GNorm = 0.5081, lr_0 = 9.9803e-04
Validation auc = 0.694192
Epoch 3214
Loss = 4.8973e-02, PNorm = 529.8960, GNorm = 2.4670, lr_0 = 9.9803e-04
Validation auc = 0.701713
Epoch 3215
Loss = 3.8880e-02, PNorm = 530.0080, GNorm = 0.6116, lr_0 = 9.9803e-04
Validation auc = 0.706620
Epoch 3216
Loss = 6.1930e-02, PNorm = 530.0939, GNorm = 0.5129, lr_0 = 9.9803e-04
Validation auc = 0.706949
Epoch 3217
Loss = 2.0230e-01, PNorm = 530.1559, GNorm = 0.2117, lr_0 = 9.9803e-04
Validation auc = 0.701360
Epoch 3218
Loss = 3.8945e-02, PNorm = 530.2421, GNorm = 3.6080, lr_0 = 9.9803e-04
Validation auc = 0.692452
Epoch 3219
Loss = 3.5902e-02, PNorm = 530.3317, GNorm = 1.9620, lr_0 = 9.9802e-04
Loss = 5.9163e-02, PNorm = 530.4499, GNorm = 0.5040, lr_0 = 9.9802e-04
Validation auc = 0.690744
Epoch 3220
Loss = 4.5011e-02, PNorm = 530.5386, GNorm = 0.3468, lr_0 = 9.9802e-04
Validation auc = 0.693622
Epoch 3221
Loss = 2.9381e-02, PNorm = 530.6029, GNorm = 1.4616, lr_0 = 9.9802e-04
Validation auc = 0.701011
Epoch 3222
Loss = 2.3110e-02, PNorm = 530.6521, GNorm = 0.1400, lr_0 = 9.9802e-04
Validation auc = 0.701422
Epoch 3223
Loss = 3.8041e-02, PNorm = 530.6980, GNorm = 0.8644, lr_0 = 9.9802e-04
Validation auc = 0.704696
Epoch 3224
Loss = 3.7593e-02, PNorm = 530.7562, GNorm = 2.0760, lr_0 = 9.9802e-04
Validation auc = 0.710555
Epoch 3225
Loss = 4.3853e-02, PNorm = 530.8398, GNorm = 1.9058, lr_0 = 9.9802e-04
Validation auc = 0.699784
Epoch 3226
Loss = 5.5946e-02, PNorm = 530.9313, GNorm = 2.8294, lr_0 = 9.9802e-04
Validation auc = 0.709947
Epoch 3227
Loss = 1.2563e-02, PNorm = 531.0220, GNorm = 0.7975, lr_0 = 9.9802e-04
Validation auc = 0.716308
Epoch 3228
Loss = 2.5605e-01, PNorm = 531.0929, GNorm = 0.7131, lr_0 = 9.9802e-04
Validation auc = 0.705995
Epoch 3229
Loss = 2.0650e-01, PNorm = 531.1694, GNorm = 4.9277, lr_0 = 9.9802e-04
Loss = 7.9798e-02, PNorm = 531.2474, GNorm = 1.8509, lr_0 = 9.9802e-04
Validation auc = 0.716386
Epoch 3230
Loss = 5.4358e-02, PNorm = 531.3177, GNorm = 3.8253, lr_0 = 9.9802e-04
Validation auc = 0.721093
Epoch 3231
Loss = 3.7619e-02, PNorm = 531.3813, GNorm = 2.1508, lr_0 = 9.9801e-04
Validation auc = 0.727030
Epoch 3232
Loss = 7.5725e-02, PNorm = 531.4524, GNorm = 3.7123, lr_0 = 9.9801e-04
Validation auc = 0.738078
Epoch 3233
Loss = 1.4886e-02, PNorm = 531.5356, GNorm = 1.4139, lr_0 = 9.9801e-04
Validation auc = 0.736200
Epoch 3234
Loss = 1.2841e-02, PNorm = 531.5931, GNorm = 0.8116, lr_0 = 9.9801e-04
Validation auc = 0.736168
Epoch 3235
Loss = 2.5447e-02, PNorm = 531.6397, GNorm = 0.6611, lr_0 = 9.9801e-04
Validation auc = 0.739666
Epoch 3236
Loss = 3.8650e-02, PNorm = 531.6978, GNorm = 0.7522, lr_0 = 9.9801e-04
Validation auc = 0.729448
Epoch 3237
Loss = 6.5664e-02, PNorm = 531.7599, GNorm = 2.9406, lr_0 = 9.9801e-04
Validation auc = 0.724171
Epoch 3238
Loss = 4.4074e-02, PNorm = 531.8309, GNorm = 0.9629, lr_0 = 9.9801e-04
Validation auc = 0.724634
Epoch 3239
Loss = 1.5100e-02, PNorm = 531.9034, GNorm = 0.6796, lr_0 = 9.9801e-04
Loss = 4.8400e-02, PNorm = 531.9764, GNorm = 2.3589, lr_0 = 9.9801e-04
Validation auc = 0.715470
Epoch 3240
Loss = 2.6135e-02, PNorm = 532.0492, GNorm = 0.6289, lr_0 = 9.9801e-04
Validation auc = 0.706567
Epoch 3241
Loss = 5.5437e-02, PNorm = 532.1045, GNorm = 3.3183, lr_0 = 9.9801e-04
Validation auc = 0.705557
Epoch 3242
Loss = 3.0998e-02, PNorm = 532.1637, GNorm = 0.1164, lr_0 = 9.9801e-04
Validation auc = 0.715956
Epoch 3243
Loss = 1.3078e-01, PNorm = 532.2351, GNorm = 3.1164, lr_0 = 9.9801e-04
Validation auc = 0.710112
Epoch 3244
Loss = 3.7827e-02, PNorm = 532.3211, GNorm = 0.6646, lr_0 = 9.9801e-04
Validation auc = 0.712559
Epoch 3245
Loss = 1.6909e-01, PNorm = 532.4026, GNorm = 0.9886, lr_0 = 9.9800e-04
Validation auc = 0.711346
Epoch 3246
Loss = 2.6270e-02, PNorm = 532.4904, GNorm = 0.8580, lr_0 = 9.9800e-04
Validation auc = 0.710231
Epoch 3247
Loss = 8.3403e-02, PNorm = 532.5599, GNorm = 1.1589, lr_0 = 9.9800e-04
Validation auc = 0.700246
Epoch 3248
Loss = 7.7889e-02, PNorm = 532.6243, GNorm = 0.6341, lr_0 = 9.9800e-04
Validation auc = 0.705202
Epoch 3249
Loss = 1.5961e-01, PNorm = 532.6832, GNorm = 3.3103, lr_0 = 9.9800e-04
Loss = 6.5054e-02, PNorm = 532.7374, GNorm = 6.7038, lr_0 = 9.9800e-04
Validation auc = 0.714876
Epoch 3250
Loss = 8.3992e-02, PNorm = 532.8041, GNorm = 1.3994, lr_0 = 9.9800e-04
Validation auc = 0.717920
Epoch 3251
Loss = 6.9614e-02, PNorm = 532.8774, GNorm = 0.5730, lr_0 = 9.9800e-04
Validation auc = 0.715564
Epoch 3252
Loss = 6.4374e-02, PNorm = 532.9448, GNorm = 1.6284, lr_0 = 9.9800e-04
Validation auc = 0.711619
Epoch 3253
Loss = 7.3342e-02, PNorm = 533.0016, GNorm = 2.9558, lr_0 = 9.9800e-04
Validation auc = 0.714789
Epoch 3254
Loss = 1.3736e-02, PNorm = 533.0682, GNorm = 0.5932, lr_0 = 9.9800e-04
Validation auc = 0.710458
Epoch 3255
Loss = 4.0753e-02, PNorm = 533.1332, GNorm = 4.0618, lr_0 = 9.9800e-04
Validation auc = 0.706991
Epoch 3256
Loss = 1.9452e-01, PNorm = 533.1946, GNorm = 2.3257, lr_0 = 9.9800e-04
Validation auc = 0.705271
Epoch 3257
Loss = 4.6683e-02, PNorm = 533.2678, GNorm = 2.6640, lr_0 = 9.9800e-04
Validation auc = 0.713487
Epoch 3258
Loss = 1.9406e-02, PNorm = 533.3399, GNorm = 0.5121, lr_0 = 9.9799e-04
Validation auc = 0.719918
Epoch 3259
Loss = 3.5996e-02, PNorm = 533.3925, GNorm = 2.6217, lr_0 = 9.9799e-04
Loss = 4.3062e-02, PNorm = 533.4447, GNorm = 0.7355, lr_0 = 9.9799e-04
Validation auc = 0.713864
Epoch 3260
Loss = 3.8887e-02, PNorm = 533.5142, GNorm = 6.8785, lr_0 = 9.9799e-04
Validation auc = 0.707992
Epoch 3261
Loss = 5.5158e-02, PNorm = 533.6116, GNorm = 0.6489, lr_0 = 9.9799e-04
Validation auc = 0.720440
Epoch 3262
Loss = 4.0471e-02, PNorm = 533.6967, GNorm = 3.5623, lr_0 = 9.9799e-04
Validation auc = 0.729891
Epoch 3263
Loss = 1.6005e-01, PNorm = 533.7860, GNorm = 0.9778, lr_0 = 9.9799e-04
Validation auc = 0.724728
Epoch 3264
Loss = 1.0243e-01, PNorm = 533.9047, GNorm = 1.1739, lr_0 = 9.9799e-04
Validation auc = 0.708412
Epoch 3265
Loss = 1.5202e-02, PNorm = 534.0173, GNorm = 0.1132, lr_0 = 9.9799e-04
Validation auc = 0.695123
Epoch 3266
Loss = 1.4546e-01, PNorm = 534.1011, GNorm = 4.8964, lr_0 = 9.9799e-04
Validation auc = 0.700761
Epoch 3267
Loss = 1.6941e-01, PNorm = 534.1972, GNorm = 5.9974, lr_0 = 9.9799e-04
Validation auc = 0.706198
Epoch 3268
Loss = 1.5914e-01, PNorm = 534.2925, GNorm = 0.2401, lr_0 = 9.9799e-04
Validation auc = 0.703211
Epoch 3269
Loss = 3.1763e-02, PNorm = 534.3974, GNorm = 1.1552, lr_0 = 9.9799e-04
Loss = 6.2204e-02, PNorm = 534.4871, GNorm = 0.3320, lr_0 = 9.9799e-04
Validation auc = 0.706302
Epoch 3270
Loss = 4.4805e-02, PNorm = 534.5570, GNorm = 0.2991, lr_0 = 9.9799e-04
Validation auc = 0.705344
Epoch 3271
Loss = 1.0335e-01, PNorm = 534.6217, GNorm = 1.3377, lr_0 = 9.9798e-04
Validation auc = 0.701955
Epoch 3272
Loss = 2.6704e-02, PNorm = 534.6979, GNorm = 0.1778, lr_0 = 9.9798e-04
Validation auc = 0.699676
Epoch 3273
Loss = 4.7282e-02, PNorm = 534.7542, GNorm = 0.5505, lr_0 = 9.9798e-04
Validation auc = 0.696880
Epoch 3274
Loss = 9.1649e-02, PNorm = 534.8052, GNorm = 0.5658, lr_0 = 9.9798e-04
Validation auc = 0.701637
Epoch 3275
Loss = 1.6489e-02, PNorm = 534.8756, GNorm = 0.2979, lr_0 = 9.9798e-04
Validation auc = 0.705695
Epoch 3276
Loss = 1.1640e-01, PNorm = 534.9445, GNorm = 5.1242, lr_0 = 9.9798e-04
Validation auc = 0.702071
Epoch 3277
Loss = 5.7828e-02, PNorm = 535.0394, GNorm = 0.2851, lr_0 = 9.9798e-04
Validation auc = 0.694890
Epoch 3278
Loss = 4.2767e-02, PNorm = 535.1433, GNorm = 1.6509, lr_0 = 9.9798e-04
Validation auc = 0.689128
Epoch 3279
Loss = 5.6821e-02, PNorm = 535.2128, GNorm = 1.8402, lr_0 = 9.9798e-04
Loss = 4.6844e-02, PNorm = 535.2685, GNorm = 0.1489, lr_0 = 9.9798e-04
Validation auc = 0.689424
Epoch 3280
Loss = 3.2728e-02, PNorm = 535.3148, GNorm = 0.2843, lr_0 = 9.9798e-04
Validation auc = 0.696508
Epoch 3281
Loss = 4.8383e-02, PNorm = 535.3534, GNorm = 4.0920, lr_0 = 9.9798e-04
Validation auc = 0.700052
Epoch 3282
Loss = 2.6892e-02, PNorm = 535.3921, GNorm = 2.7893, lr_0 = 9.9798e-04
Validation auc = 0.705549
Epoch 3283
Loss = 1.1030e-01, PNorm = 535.4344, GNorm = 6.4110, lr_0 = 9.9798e-04
Validation auc = 0.704814
Epoch 3284
Loss = 1.9092e-01, PNorm = 535.5009, GNorm = 0.2782, lr_0 = 9.9798e-04
Validation auc = 0.707009
Epoch 3285
Loss = 1.1031e-01, PNorm = 535.5846, GNorm = 0.5618, lr_0 = 9.9797e-04
Validation auc = 0.704802
Epoch 3286
Loss = 6.0244e-02, PNorm = 535.6568, GNorm = 1.0040, lr_0 = 9.9797e-04
Validation auc = 0.707858
Epoch 3287
Loss = 7.2732e-02, PNorm = 535.7223, GNorm = 2.9528, lr_0 = 9.9797e-04
Validation auc = 0.721221
Epoch 3288
Loss = 1.2184e-01, PNorm = 535.7836, GNorm = 3.7892, lr_0 = 9.9797e-04
Validation auc = 0.724363
Epoch 3289
Loss = 1.6352e-01, PNorm = 535.8508, GNorm = 4.6149, lr_0 = 9.9797e-04
Loss = 3.0191e-02, PNorm = 535.9044, GNorm = 1.7132, lr_0 = 9.9797e-04
Validation auc = 0.720148
Epoch 3290
Loss = 1.0429e-01, PNorm = 535.9474, GNorm = 0.6758, lr_0 = 9.9797e-04
Validation auc = 0.717444
Epoch 3291
Loss = 4.9243e-02, PNorm = 535.9965, GNorm = 4.5933, lr_0 = 9.9797e-04
Validation auc = 0.719276
Epoch 3292
Loss = 2.4711e-02, PNorm = 536.0530, GNorm = 0.8895, lr_0 = 9.9797e-04
Validation auc = 0.718702
Epoch 3293
Loss = 2.4901e-02, PNorm = 536.1037, GNorm = 0.8960, lr_0 = 9.9797e-04
Validation auc = 0.718755
Epoch 3294
Loss = 3.4575e-02, PNorm = 536.1511, GNorm = 0.3752, lr_0 = 9.9797e-04
Validation auc = 0.724974
Epoch 3295
Loss = 3.7161e-02, PNorm = 536.1978, GNorm = 0.2629, lr_0 = 9.9797e-04
Validation auc = 0.728633
Epoch 3296
Loss = 1.6459e-02, PNorm = 536.2407, GNorm = 0.4862, lr_0 = 9.9797e-04
Validation auc = 0.725071
Epoch 3297
Loss = 6.0475e-02, PNorm = 536.3013, GNorm = 0.1575, lr_0 = 9.9797e-04
Validation auc = 0.720645
Epoch 3298
Loss = 1.2822e-01, PNorm = 536.3751, GNorm = 3.3079, lr_0 = 9.9796e-04
Validation auc = 0.722467
Epoch 3299
Loss = 2.6213e-02, PNorm = 536.4767, GNorm = 1.0208, lr_0 = 9.9796e-04
Loss = 1.0159e-01, PNorm = 536.5699, GNorm = 1.8732, lr_0 = 9.9796e-04
Validation auc = 0.722634
Epoch 3300
Loss = 4.6765e-02, PNorm = 536.6622, GNorm = 0.2871, lr_0 = 9.9796e-04
Validation auc = 0.729651
Epoch 3301
Loss = 2.8435e-02, PNorm = 536.7309, GNorm = 0.6163, lr_0 = 9.9796e-04
Validation auc = 0.731745
Epoch 3302
Loss = 5.8047e-02, PNorm = 536.7895, GNorm = 0.4296, lr_0 = 9.9796e-04
Validation auc = 0.733750
Epoch 3303
Loss = 4.6585e-02, PNorm = 536.8381, GNorm = 0.2390, lr_0 = 9.9796e-04
Validation auc = 0.724634
Epoch 3304
Loss = 8.4759e-02, PNorm = 536.8884, GNorm = 2.0165, lr_0 = 9.9796e-04
Validation auc = 0.724760
Epoch 3305
Loss = 5.1534e-02, PNorm = 536.9382, GNorm = 0.2587, lr_0 = 9.9796e-04
Validation auc = 0.731074
Epoch 3306
Loss = 2.8997e-02, PNorm = 536.9798, GNorm = 0.4579, lr_0 = 9.9796e-04
Validation auc = 0.731270
Epoch 3307
Loss = 1.6891e-02, PNorm = 537.0195, GNorm = 0.2254, lr_0 = 9.9796e-04
Validation auc = 0.729371
Epoch 3308
Loss = 6.8752e-03, PNorm = 537.0540, GNorm = 0.3097, lr_0 = 9.9796e-04
Validation auc = 0.733996
Epoch 3309
Loss = 9.6877e-03, PNorm = 537.0875, GNorm = 0.5728, lr_0 = 9.9796e-04
Loss = 8.1571e-02, PNorm = 537.1405, GNorm = 0.7771, lr_0 = 9.9796e-04
Validation auc = 0.733852
Epoch 3310
Loss = 3.0957e-02, PNorm = 537.2024, GNorm = 0.9822, lr_0 = 9.9796e-04
Validation auc = 0.734071
Epoch 3311
Loss = 9.6418e-02, PNorm = 537.2488, GNorm = 8.7178, lr_0 = 9.9795e-04
Validation auc = 0.729466
Epoch 3312
Loss = 6.3386e-02, PNorm = 537.3101, GNorm = 2.7569, lr_0 = 9.9795e-04
Validation auc = 0.726854
Epoch 3313
Loss = 3.6211e-02, PNorm = 537.3812, GNorm = 1.5426, lr_0 = 9.9795e-04
Validation auc = 0.727085
Epoch 3314
Loss = 2.2775e-02, PNorm = 537.4420, GNorm = 0.1480, lr_0 = 9.9795e-04
Validation auc = 0.728814
Epoch 3315
Loss = 8.6541e-02, PNorm = 537.4947, GNorm = 0.7136, lr_0 = 9.9795e-04
Validation auc = 0.728596
Epoch 3316
Loss = 3.3616e-02, PNorm = 537.5431, GNorm = 1.6221, lr_0 = 9.9795e-04
Validation auc = 0.729181
Epoch 3317
Loss = 1.4748e-02, PNorm = 537.5844, GNorm = 0.6208, lr_0 = 9.9795e-04
Validation auc = 0.731122
Epoch 3318
Loss = 1.5466e-02, PNorm = 537.6212, GNorm = 1.6096, lr_0 = 9.9795e-04
Validation auc = 0.731828
Epoch 3319
Loss = 8.5173e-02, PNorm = 537.6742, GNorm = 1.4558, lr_0 = 9.9795e-04
Loss = 4.5292e-02, PNorm = 537.7263, GNorm = 3.1505, lr_0 = 9.9795e-04
Validation auc = 0.725123
Epoch 3320
Loss = 3.9849e-02, PNorm = 537.7842, GNorm = 0.7041, lr_0 = 9.9795e-04
Validation auc = 0.723723
Epoch 3321
Loss = 4.3880e-02, PNorm = 537.8520, GNorm = 0.8811, lr_0 = 9.9795e-04
Validation auc = 0.713790
Epoch 3322
Loss = 3.2840e-02, PNorm = 537.9105, GNorm = 0.0133, lr_0 = 9.9795e-04
Validation auc = 0.712746
Epoch 3323
Loss = 4.4863e-02, PNorm = 537.9638, GNorm = 0.2855, lr_0 = 9.9795e-04
Validation auc = 0.721413
Epoch 3324
Loss = 2.2910e-02, PNorm = 538.0109, GNorm = 0.1665, lr_0 = 9.9794e-04
Validation auc = 0.720224
Epoch 3325
Loss = 4.2147e-02, PNorm = 538.0561, GNorm = 1.0714, lr_0 = 9.9794e-04
Validation auc = 0.710416
Epoch 3326
Loss = 1.0366e-02, PNorm = 538.1074, GNorm = 0.2675, lr_0 = 9.9794e-04
Validation auc = 0.706700
Epoch 3327
Loss = 2.0167e-02, PNorm = 538.1495, GNorm = 0.0393, lr_0 = 9.9794e-04
Validation auc = 0.698916
Epoch 3328
Loss = 1.5979e-02, PNorm = 538.2130, GNorm = 2.7493, lr_0 = 9.9794e-04
Validation auc = 0.693389
Epoch 3329
Loss = 3.8279e-02, PNorm = 538.3127, GNorm = 4.1930, lr_0 = 9.9794e-04
Loss = 2.9663e-02, PNorm = 538.4033, GNorm = 3.5840, lr_0 = 9.9794e-04
Validation auc = 0.699806
Epoch 3330
Loss = 1.0008e-01, PNorm = 538.5014, GNorm = 1.2022, lr_0 = 9.9794e-04
Validation auc = 0.707527
Epoch 3331
Loss = 4.8648e-02, PNorm = 538.5937, GNorm = 4.5810, lr_0 = 9.9794e-04
Validation auc = 0.711867
Epoch 3332
Loss = 5.9186e-02, PNorm = 538.6684, GNorm = 0.5792, lr_0 = 9.9794e-04
Validation auc = 0.716365
Epoch 3333
Loss = 2.8239e-02, PNorm = 538.7313, GNorm = 1.3265, lr_0 = 9.9794e-04
Validation auc = 0.719790
Epoch 3334
Loss = 3.1342e-02, PNorm = 538.7989, GNorm = 0.1593, lr_0 = 9.9794e-04
Validation auc = 0.719184
Epoch 3335
Loss = 3.7742e-02, PNorm = 538.8759, GNorm = 0.4769, lr_0 = 9.9794e-04
Validation auc = 0.713842
Epoch 3336
Loss = 9.7081e-02, PNorm = 538.9414, GNorm = 3.4220, lr_0 = 9.9794e-04
Validation auc = 0.714644
Epoch 3337
Loss = 1.8833e-02, PNorm = 539.0028, GNorm = 0.3506, lr_0 = 9.9794e-04
Validation auc = 0.716865
Epoch 3338
Loss = 1.2693e-02, PNorm = 539.0515, GNorm = 0.8348, lr_0 = 9.9793e-04
Validation auc = 0.727264
Epoch 3339
Loss = 9.0396e-03, PNorm = 539.0975, GNorm = 1.6560, lr_0 = 9.9793e-04
Loss = 2.7504e-02, PNorm = 539.1432, GNorm = 0.0147, lr_0 = 9.9793e-04
Validation auc = 0.729374
Epoch 3340
Loss = 4.4816e-02, PNorm = 539.1915, GNorm = 1.0000, lr_0 = 9.9793e-04
Validation auc = 0.737114
Epoch 3341
Loss = 6.9208e-02, PNorm = 539.2495, GNorm = 2.8636, lr_0 = 9.9793e-04
Validation auc = 0.739361
Epoch 3342
Loss = 4.6898e-02, PNorm = 539.3097, GNorm = 0.1993, lr_0 = 9.9793e-04
Validation auc = 0.734433
Epoch 3343
Loss = 6.0674e-02, PNorm = 539.3779, GNorm = 1.1966, lr_0 = 9.9793e-04
Validation auc = 0.733503
Epoch 3344
Loss = 9.1994e-03, PNorm = 539.4325, GNorm = 0.2844, lr_0 = 9.9793e-04
Validation auc = 0.727528
Epoch 3345
Loss = 8.2889e-02, PNorm = 539.4899, GNorm = 2.1068, lr_0 = 9.9793e-04
Validation auc = 0.726979
Epoch 3346
Loss = 3.6825e-02, PNorm = 539.5675, GNorm = 1.8333, lr_0 = 9.9793e-04
Validation auc = 0.728981
Epoch 3347
Loss = 6.0729e-02, PNorm = 539.6461, GNorm = 4.3954, lr_0 = 9.9793e-04
Validation auc = 0.730914
Epoch 3348
Loss = 4.0461e-02, PNorm = 539.7292, GNorm = 2.8091, lr_0 = 9.9793e-04
Validation auc = 0.727531
Epoch 3349
Loss = 1.4933e-02, PNorm = 539.7935, GNorm = 0.7266, lr_0 = 9.9793e-04
Loss = 3.1962e-02, PNorm = 539.8523, GNorm = 0.8481, lr_0 = 9.9793e-04
Validation auc = 0.717600
Epoch 3350
Loss = 2.8590e-02, PNorm = 539.9112, GNorm = 1.0128, lr_0 = 9.9792e-04
Validation auc = 0.707212
Epoch 3351
Loss = 2.7456e-02, PNorm = 539.9548, GNorm = 5.4038, lr_0 = 9.9792e-04
Validation auc = 0.702678
Epoch 3352
Loss = 3.8747e-02, PNorm = 539.9973, GNorm = 1.5702, lr_0 = 9.9792e-04
Validation auc = 0.705844
Epoch 3353
Loss = 1.4279e-02, PNorm = 540.0449, GNorm = 0.1662, lr_0 = 9.9792e-04
Validation auc = 0.713607
Epoch 3354
Loss = 2.1437e-02, PNorm = 540.0849, GNorm = 1.5935, lr_0 = 9.9792e-04
Validation auc = 0.714362
Epoch 3355
Loss = 8.6541e-03, PNorm = 540.1202, GNorm = 0.2402, lr_0 = 9.9792e-04
Validation auc = 0.713458
Epoch 3356
Loss = 1.5633e-02, PNorm = 540.1616, GNorm = 1.2171, lr_0 = 9.9792e-04
Validation auc = 0.713777
Epoch 3357
Loss = 1.9965e-02, PNorm = 540.2072, GNorm = 1.1749, lr_0 = 9.9792e-04
Validation auc = 0.719858
Epoch 3358
Loss = 1.5951e-02, PNorm = 540.2484, GNorm = 0.3470, lr_0 = 9.9792e-04
Validation auc = 0.720573
Epoch 3359
Loss = 4.6592e-03, PNorm = 540.2945, GNorm = 0.2144, lr_0 = 9.9792e-04
Loss = 3.2127e-02, PNorm = 540.3381, GNorm = 4.8436, lr_0 = 9.9792e-04
Validation auc = 0.719185
Epoch 3360
Loss = 3.1232e-02, PNorm = 540.3909, GNorm = 0.0438, lr_0 = 9.9792e-04
Validation auc = 0.720056
Epoch 3361
Loss = 5.5720e-02, PNorm = 540.4480, GNorm = 4.6932, lr_0 = 9.9792e-04
Validation auc = 0.711901
Epoch 3362
Loss = 5.9184e-02, PNorm = 540.5084, GNorm = 4.2056, lr_0 = 9.9792e-04
Validation auc = 0.710802
Epoch 3363
Loss = 4.7355e-02, PNorm = 540.5894, GNorm = 0.6621, lr_0 = 9.9792e-04
Validation auc = 0.712097
Epoch 3364
Loss = 8.6273e-02, PNorm = 540.6763, GNorm = 0.7050, lr_0 = 9.9791e-04
Validation auc = 0.716178
Epoch 3365
Loss = 8.0542e-02, PNorm = 540.7692, GNorm = 1.1899, lr_0 = 9.9791e-04
Validation auc = 0.715380
Epoch 3366
Loss = 6.7702e-02, PNorm = 540.8685, GNorm = 3.2152, lr_0 = 9.9791e-04
Validation auc = 0.713368
Epoch 3367
Loss = 3.8035e-02, PNorm = 540.9533, GNorm = 1.5129, lr_0 = 9.9791e-04
Validation auc = 0.713668
Epoch 3368
Loss = 6.3790e-02, PNorm = 541.0303, GNorm = 0.6193, lr_0 = 9.9791e-04
Validation auc = 0.713961
Epoch 3369
Loss = 1.1847e-01, PNorm = 541.1126, GNorm = 3.0481, lr_0 = 9.9791e-04
Loss = 6.1131e-02, PNorm = 541.1981, GNorm = 0.2644, lr_0 = 9.9791e-04
Validation auc = 0.708350
Epoch 3370
Loss = 1.9688e-02, PNorm = 541.2640, GNorm = 0.0921, lr_0 = 9.9791e-04
Validation auc = 0.708738
Epoch 3371
Loss = 2.2363e-02, PNorm = 541.3151, GNorm = 0.4799, lr_0 = 9.9791e-04
Validation auc = 0.706240
Epoch 3372
Loss = 2.8656e-02, PNorm = 541.3592, GNorm = 0.7127, lr_0 = 9.9791e-04
Validation auc = 0.707175
Epoch 3373
Loss = 1.9337e-02, PNorm = 541.3946, GNorm = 2.0408, lr_0 = 9.9791e-04
Validation auc = 0.708080
Epoch 3374
Loss = 2.5927e-02, PNorm = 541.4282, GNorm = 0.4377, lr_0 = 9.9791e-04
Validation auc = 0.710694
Epoch 3375
Loss = 1.6439e-01, PNorm = 541.4726, GNorm = 8.5415, lr_0 = 9.9791e-04
Validation auc = 0.714216
Epoch 3376
Loss = 3.1619e-02, PNorm = 541.5541, GNorm = 0.2800, lr_0 = 9.9791e-04
Validation auc = 0.711413
Epoch 3377
Loss = 1.3928e-02, PNorm = 541.6133, GNorm = 1.3925, lr_0 = 9.9790e-04
Validation auc = 0.702528
Epoch 3378
Loss = 2.8939e-02, PNorm = 541.6678, GNorm = 1.8763, lr_0 = 9.9790e-04
Validation auc = 0.695582
Epoch 3379
Loss = 3.2835e-02, PNorm = 541.7370, GNorm = 1.2962, lr_0 = 9.9790e-04
Loss = 5.1961e-02, PNorm = 541.8062, GNorm = 0.3292, lr_0 = 9.9790e-04
Validation auc = 0.696481
Epoch 3380
Loss = 3.3197e-02, PNorm = 541.8710, GNorm = 0.2359, lr_0 = 9.9790e-04
Validation auc = 0.700591
Epoch 3381
Loss = 3.2016e-02, PNorm = 541.9195, GNorm = 3.4693, lr_0 = 9.9790e-04
Validation auc = 0.712878
Epoch 3382
Loss = 1.7808e-02, PNorm = 541.9676, GNorm = 0.0326, lr_0 = 9.9790e-04
Validation auc = 0.712565
Epoch 3383
Loss = 6.7441e-02, PNorm = 542.0228, GNorm = 6.0930, lr_0 = 9.9790e-04
Validation auc = 0.717636
Epoch 3384
Loss = 4.9941e-02, PNorm = 542.0858, GNorm = 0.9794, lr_0 = 9.9790e-04
Validation auc = 0.724941
Epoch 3385
Loss = 7.5554e-02, PNorm = 542.1579, GNorm = 3.1189, lr_0 = 9.9790e-04
Validation auc = 0.722158
Epoch 3386
Loss = 2.0338e-02, PNorm = 542.2251, GNorm = 2.3379, lr_0 = 9.9790e-04
Validation auc = 0.714979
Epoch 3387
Loss = 3.4123e-02, PNorm = 542.2885, GNorm = 0.2526, lr_0 = 9.9790e-04
Validation auc = 0.709854
Epoch 3388
Loss = 6.0203e-02, PNorm = 542.3386, GNorm = 3.1699, lr_0 = 9.9790e-04
Validation auc = 0.705500
Epoch 3389
Loss = 1.3315e-03, PNorm = 542.3904, GNorm = 0.1674, lr_0 = 9.9790e-04
Loss = 1.2459e-01, PNorm = 542.4549, GNorm = 6.5136, lr_0 = 9.9790e-04
Validation auc = 0.713064
Epoch 3390
Loss = 6.7420e-02, PNorm = 542.5295, GNorm = 1.8395, lr_0 = 9.9789e-04
Validation auc = 0.715324
Epoch 3391
Loss = 2.6015e-02, PNorm = 542.5938, GNorm = 0.3283, lr_0 = 9.9789e-04
Validation auc = 0.720186
Epoch 3392
Loss = 4.5352e-02, PNorm = 542.6431, GNorm = 1.5015, lr_0 = 9.9789e-04
Validation auc = 0.727058
Epoch 3393
Loss = 4.1374e-02, PNorm = 542.7042, GNorm = 0.7964, lr_0 = 9.9789e-04
Validation auc = 0.715675
Epoch 3394
Loss = 1.7218e-02, PNorm = 542.7666, GNorm = 0.5498, lr_0 = 9.9789e-04
Validation auc = 0.720882
Epoch 3395
Loss = 1.7135e-02, PNorm = 542.8093, GNorm = 1.0987, lr_0 = 9.9789e-04
Validation auc = 0.727295
Epoch 3396
Loss = 5.1656e-02, PNorm = 542.8449, GNorm = 5.0579, lr_0 = 9.9789e-04
Validation auc = 0.733168
Epoch 3397
Loss = 3.9546e-02, PNorm = 542.8947, GNorm = 2.6867, lr_0 = 9.9789e-04
Validation auc = 0.714200
Epoch 3398
Loss = 2.3673e-02, PNorm = 542.9648, GNorm = 1.4025, lr_0 = 9.9789e-04
Validation auc = 0.710979
Epoch 3399
Loss = 7.1038e-02, PNorm = 543.0237, GNorm = 1.7311, lr_0 = 9.9789e-04
Loss = 4.1218e-02, PNorm = 543.0772, GNorm = 0.1018, lr_0 = 9.9789e-04
Validation auc = 0.710331
Epoch 3400
Loss = 3.7567e-02, PNorm = 543.1259, GNorm = 0.9446, lr_0 = 9.9789e-04
Validation auc = 0.710799
Epoch 3401
Loss = 4.2409e-02, PNorm = 543.1943, GNorm = 1.1661, lr_0 = 9.9789e-04
Validation auc = 0.721431
Epoch 3402
Loss = 2.3859e-02, PNorm = 543.2719, GNorm = 1.0468, lr_0 = 9.9789e-04
Validation auc = 0.727165
Epoch 3403
Loss = 8.0040e-02, PNorm = 543.3395, GNorm = 1.3730, lr_0 = 9.9789e-04
Validation auc = 0.725353
Epoch 3404
Loss = 3.3319e-02, PNorm = 543.4019, GNorm = 2.7013, lr_0 = 9.9788e-04
Validation auc = 0.718296
Epoch 3405
Loss = 1.9532e-02, PNorm = 543.4490, GNorm = 0.2418, lr_0 = 9.9788e-04
Validation auc = 0.720628
Epoch 3406
Loss = 6.3520e-02, PNorm = 543.4877, GNorm = 0.4034, lr_0 = 9.9788e-04
Validation auc = 0.725138
Epoch 3407
Loss = 7.5598e-03, PNorm = 543.5361, GNorm = 0.0801, lr_0 = 9.9788e-04
Validation auc = 0.729359
Epoch 3408
Loss = 2.4171e-01, PNorm = 543.6054, GNorm = 0.4591, lr_0 = 9.9788e-04
Validation auc = 0.732570
Epoch 3409
Loss = 3.5964e-03, PNorm = 543.6834, GNorm = 0.3099, lr_0 = 9.9788e-04
Loss = 4.1381e-02, PNorm = 543.7499, GNorm = 2.2651, lr_0 = 9.9788e-04
Validation auc = 0.734150
Epoch 3410
Loss = 3.5207e-02, PNorm = 543.8150, GNorm = 1.0306, lr_0 = 9.9788e-04
Validation auc = 0.731871
Epoch 3411
Loss = 3.0359e-02, PNorm = 543.8904, GNorm = 0.4497, lr_0 = 9.9788e-04
Validation auc = 0.739464
Epoch 3412
Loss = 1.6319e-02, PNorm = 543.9557, GNorm = 2.1099, lr_0 = 9.9788e-04
Validation auc = 0.736910
Epoch 3413
Loss = 4.2117e-02, PNorm = 544.0116, GNorm = 0.0612, lr_0 = 9.9788e-04
Validation auc = 0.737943
Epoch 3414
Loss = 4.3721e-02, PNorm = 544.0650, GNorm = 0.7215, lr_0 = 9.9788e-04
Validation auc = 0.740883
Epoch 3415
Loss = 2.8962e-02, PNorm = 544.1070, GNorm = 0.9333, lr_0 = 9.9788e-04
Validation auc = 0.740695
Epoch 3416
Loss = 2.2436e-02, PNorm = 544.1470, GNorm = 0.0278, lr_0 = 9.9788e-04
Validation auc = 0.736096
Epoch 3417
Loss = 2.8661e-02, PNorm = 544.2016, GNorm = 5.0208, lr_0 = 9.9787e-04
Validation auc = 0.725953
Epoch 3418
Loss = 3.2740e-02, PNorm = 544.2811, GNorm = 1.9132, lr_0 = 9.9787e-04
Validation auc = 0.719625
Epoch 3419
Loss = 5.1382e-02, PNorm = 544.3693, GNorm = 2.5933, lr_0 = 9.9787e-04
Loss = 6.7945e-02, PNorm = 544.4646, GNorm = 0.5781, lr_0 = 9.9787e-04
Validation auc = 0.717499
Epoch 3420
Loss = 4.9797e-02, PNorm = 544.5450, GNorm = 2.0122, lr_0 = 9.9787e-04
Validation auc = 0.721626
Epoch 3421
Loss = 4.5168e-02, PNorm = 544.6099, GNorm = 1.5319, lr_0 = 9.9787e-04
Validation auc = 0.720815
Epoch 3422
Loss = 5.5703e-02, PNorm = 544.6639, GNorm = 0.6800, lr_0 = 9.9787e-04
Validation auc = 0.711944
Epoch 3423
Loss = 4.1263e-02, PNorm = 544.7251, GNorm = 0.3952, lr_0 = 9.9787e-04
Validation auc = 0.711543
Epoch 3424
Loss = 2.7057e-02, PNorm = 544.7812, GNorm = 3.1333, lr_0 = 9.9787e-04
Validation auc = 0.710754
Epoch 3425
Loss = 8.2527e-03, PNorm = 544.8315, GNorm = 0.1447, lr_0 = 9.9787e-04
Validation auc = 0.712343
Epoch 3426
Loss = 4.9565e-02, PNorm = 544.8701, GNorm = 1.6334, lr_0 = 9.9787e-04
Validation auc = 0.713988
Epoch 3427
Loss = 2.8089e-02, PNorm = 544.9026, GNorm = 2.4359, lr_0 = 9.9787e-04
Validation auc = 0.717287
Epoch 3428
Loss = 2.8629e-02, PNorm = 544.9313, GNorm = 1.3348, lr_0 = 9.9787e-04
Validation auc = 0.716327
Epoch 3429
Loss = 1.1123e-02, PNorm = 544.9753, GNorm = 0.7250, lr_0 = 9.9787e-04
Loss = 1.9414e-02, PNorm = 545.0225, GNorm = 0.0489, lr_0 = 9.9787e-04
Validation auc = 0.713514
Epoch 3430
Loss = 4.7750e-02, PNorm = 545.0637, GNorm = 6.7404, lr_0 = 9.9786e-04
Validation auc = 0.719167
Epoch 3431
Loss = 7.1118e-02, PNorm = 545.1197, GNorm = 1.5303, lr_0 = 9.9786e-04
Validation auc = 0.728258
Epoch 3432
Loss = 4.7785e-02, PNorm = 545.1911, GNorm = 0.4393, lr_0 = 9.9786e-04
Validation auc = 0.711535
Epoch 3433
Loss = 5.6905e-02, PNorm = 545.2487, GNorm = 1.9708, lr_0 = 9.9786e-04
Validation auc = 0.704163
Epoch 3434
Loss = 4.7791e-02, PNorm = 545.3039, GNorm = 2.4406, lr_0 = 9.9786e-04
Validation auc = 0.711344
Epoch 3435
Loss = 4.8320e-02, PNorm = 545.3640, GNorm = 0.2806, lr_0 = 9.9786e-04
Validation auc = 0.715818
Epoch 3436
Loss = 4.1103e-02, PNorm = 545.4199, GNorm = 0.4580, lr_0 = 9.9786e-04
Validation auc = 0.720814
Epoch 3437
Loss = 6.6522e-02, PNorm = 545.4867, GNorm = 0.6924, lr_0 = 9.9786e-04
Validation auc = 0.713287
Epoch 3438
Loss = 1.2392e-02, PNorm = 545.5692, GNorm = 2.2709, lr_0 = 9.9786e-04
Validation auc = 0.714053
Epoch 3439
Loss = 2.3665e-02, PNorm = 545.6510, GNorm = 2.5856, lr_0 = 9.9786e-04
Loss = 8.6280e-02, PNorm = 545.7189, GNorm = 1.5937, lr_0 = 9.9786e-04
Validation auc = 0.717383
Epoch 3440
Loss = 7.1620e-02, PNorm = 545.7980, GNorm = 2.2603, lr_0 = 9.9786e-04
Validation auc = 0.722555
Epoch 3441
Loss = 5.2728e-02, PNorm = 545.8773, GNorm = 2.2039, lr_0 = 9.9786e-04
Validation auc = 0.709461
Epoch 3442
Loss = 6.9852e-02, PNorm = 545.9460, GNorm = 0.1947, lr_0 = 9.9786e-04
Validation auc = 0.712777
Epoch 3443
Loss = 4.4475e-02, PNorm = 546.0131, GNorm = 1.2321, lr_0 = 9.9785e-04
Validation auc = 0.719513
Epoch 3444
Loss = 1.9493e-02, PNorm = 546.0629, GNorm = 1.0682, lr_0 = 9.9785e-04
Validation auc = 0.720517
Epoch 3445
Loss = 5.6330e-02, PNorm = 546.1044, GNorm = 3.2009, lr_0 = 9.9785e-04
Validation auc = 0.718719
Epoch 3446
Loss = 1.0931e-02, PNorm = 546.1574, GNorm = 1.4032, lr_0 = 9.9785e-04
Validation auc = 0.718452
Epoch 3447
Loss = 3.7793e-02, PNorm = 546.2100, GNorm = 0.6689, lr_0 = 9.9785e-04
Validation auc = 0.721701
Epoch 3448
Loss = 2.5373e-01, PNorm = 546.2753, GNorm = 5.5667, lr_0 = 9.9785e-04
Validation auc = 0.730697
Epoch 3449
Loss = 5.6491e-02, PNorm = 546.3516, GNorm = 3.1155, lr_0 = 9.9785e-04
Loss = 2.8378e-02, PNorm = 546.4290, GNorm = 2.7227, lr_0 = 9.9785e-04
Validation auc = 0.733965
Epoch 3450
Loss = 8.6168e-02, PNorm = 546.5013, GNorm = 0.4473, lr_0 = 9.9785e-04
Validation auc = 0.726918
Epoch 3451
Loss = 1.2965e-01, PNorm = 546.5787, GNorm = 0.6502, lr_0 = 9.9785e-04
Validation auc = 0.728435
Epoch 3452
Loss = 2.6838e-02, PNorm = 546.6419, GNorm = 2.9693, lr_0 = 9.9785e-04
Validation auc = 0.727114
Epoch 3453
Loss = 2.5451e-02, PNorm = 546.6935, GNorm = 0.6319, lr_0 = 9.9785e-04
Validation auc = 0.728415
Epoch 3454
Loss = 2.0378e-02, PNorm = 546.7388, GNorm = 0.1761, lr_0 = 9.9785e-04
Validation auc = 0.740822
Epoch 3455
Loss = 1.9802e-02, PNorm = 546.7857, GNorm = 7.1214, lr_0 = 9.9785e-04
Validation auc = 0.736767
Epoch 3456
Loss = 5.0686e-02, PNorm = 546.8497, GNorm = 5.2081, lr_0 = 9.9785e-04
Validation auc = 0.724667
Epoch 3457
Loss = 1.9319e-02, PNorm = 546.9234, GNorm = 0.0871, lr_0 = 9.9784e-04
Validation auc = 0.712654
Epoch 3458
Loss = 1.0531e-02, PNorm = 546.9913, GNorm = 1.9840, lr_0 = 9.9784e-04
Validation auc = 0.716262
Epoch 3459
Loss = 2.1252e-01, PNorm = 547.0628, GNorm = 10.1861, lr_0 = 9.9784e-04
Loss = 7.1404e-02, PNorm = 547.1673, GNorm = 0.9854, lr_0 = 9.9784e-04
Validation auc = 0.722931
Epoch 3460
Loss = 4.1298e-02, PNorm = 547.2590, GNorm = 0.5686, lr_0 = 9.9784e-04
Validation auc = 0.729180
Epoch 3461
Loss = 4.4261e-02, PNorm = 547.3374, GNorm = 1.6555, lr_0 = 9.9784e-04
Validation auc = 0.728407
Epoch 3462
Loss = 5.6320e-02, PNorm = 547.4069, GNorm = 1.8721, lr_0 = 9.9784e-04
Validation auc = 0.724141
Epoch 3463
Loss = 2.9405e-01, PNorm = 547.5060, GNorm = 3.0242, lr_0 = 9.9784e-04
Validation auc = 0.718075
Epoch 3464
Loss = 8.5457e-02, PNorm = 547.6212, GNorm = 2.5925, lr_0 = 9.9784e-04
Validation auc = 0.719131
Epoch 3465
Loss = 2.7151e-02, PNorm = 547.7208, GNorm = 1.2272, lr_0 = 9.9784e-04
Validation auc = 0.724854
Epoch 3466
Loss = 8.2289e-02, PNorm = 547.7991, GNorm = 1.9060, lr_0 = 9.9784e-04
Validation auc = 0.744593
Epoch 3467
Loss = 4.1929e-02, PNorm = 547.8810, GNorm = 0.9055, lr_0 = 9.9784e-04
Validation auc = 0.751640
Epoch 3468
Loss = 1.1941e-02, PNorm = 547.9715, GNorm = 0.3307, lr_0 = 9.9784e-04
Validation auc = 0.750871
Epoch 3469
Loss = 3.9339e-02, PNorm = 548.0693, GNorm = 3.6308, lr_0 = 9.9784e-04
Loss = 2.8403e-02, PNorm = 548.1457, GNorm = 2.6941, lr_0 = 9.9783e-04
Validation auc = 0.745576
Epoch 3470
Loss = 4.5586e-02, PNorm = 548.2166, GNorm = 0.5318, lr_0 = 9.9783e-04
Validation auc = 0.738628
Epoch 3471
Loss = 1.7652e-02, PNorm = 548.2703, GNorm = 0.9516, lr_0 = 9.9783e-04
Validation auc = 0.732372
Epoch 3472
Loss = 2.9168e-02, PNorm = 548.3100, GNorm = 5.5392, lr_0 = 9.9783e-04
Validation auc = 0.728332
Epoch 3473
Loss = 9.8286e-02, PNorm = 548.3516, GNorm = 7.5416, lr_0 = 9.9783e-04
Validation auc = 0.724178
Epoch 3474
Loss = 4.0515e-02, PNorm = 548.4017, GNorm = 6.7337, lr_0 = 9.9783e-04
Validation auc = 0.708120
Epoch 3475
Loss = 6.0107e-02, PNorm = 548.4791, GNorm = 3.2953, lr_0 = 9.9783e-04
Validation auc = 0.706670
Epoch 3476
Loss = 1.1072e-02, PNorm = 548.5585, GNorm = 0.1211, lr_0 = 9.9783e-04
Validation auc = 0.716521
Epoch 3477
Loss = 5.4927e-02, PNorm = 548.6170, GNorm = 1.1416, lr_0 = 9.9783e-04
Validation auc = 0.726351
Epoch 3478
Loss = 7.4738e-02, PNorm = 548.6831, GNorm = 0.2263, lr_0 = 9.9783e-04
Validation auc = 0.723821
Epoch 3479
Loss = 2.7574e-02, PNorm = 548.7673, GNorm = 1.3276, lr_0 = 9.9783e-04
Loss = 5.1425e-02, PNorm = 548.8545, GNorm = 1.6738, lr_0 = 9.9783e-04
Validation auc = 0.707359
Epoch 3480
Loss = 7.3545e-02, PNorm = 548.9330, GNorm = 0.1795, lr_0 = 9.9783e-04
Validation auc = 0.711369
Epoch 3481
Loss = 5.7460e-02, PNorm = 549.0105, GNorm = 0.3030, lr_0 = 9.9783e-04
Validation auc = 0.720524
Epoch 3482
Loss = 2.9403e-02, PNorm = 549.0722, GNorm = 2.0452, lr_0 = 9.9783e-04
Validation auc = 0.721256
Epoch 3483
Loss = 2.9234e-02, PNorm = 549.1177, GNorm = 0.4057, lr_0 = 9.9782e-04
Validation auc = 0.724583
Epoch 3484
Loss = 1.0432e-01, PNorm = 549.1628, GNorm = 1.0133, lr_0 = 9.9782e-04
Validation auc = 0.731619
Epoch 3485
Loss = 3.0321e-02, PNorm = 549.2199, GNorm = 4.5831, lr_0 = 9.9782e-04
Validation auc = 0.732204
Epoch 3486
Loss = 1.5421e-02, PNorm = 549.2917, GNorm = 0.8153, lr_0 = 9.9782e-04
Validation auc = 0.733748
Epoch 3487
Loss = 2.2143e-02, PNorm = 549.3799, GNorm = 1.7161, lr_0 = 9.9782e-04
Validation auc = 0.734221
Epoch 3488
Loss = 1.3387e-02, PNorm = 549.4497, GNorm = 0.3279, lr_0 = 9.9782e-04
Validation auc = 0.732385
Epoch 3489
Loss = 3.9145e-02, PNorm = 549.5035, GNorm = 1.3296, lr_0 = 9.9782e-04
Loss = 4.9769e-02, PNorm = 549.5547, GNorm = 2.0919, lr_0 = 9.9782e-04
Validation auc = 0.719006
Epoch 3490
Loss = 7.4353e-02, PNorm = 549.6141, GNorm = 1.9485, lr_0 = 9.9782e-04
Validation auc = 0.721421
Epoch 3491
Loss = 5.5972e-02, PNorm = 549.6763, GNorm = 2.2516, lr_0 = 9.9782e-04
Validation auc = 0.712435
Epoch 3492
Loss = 2.2694e-02, PNorm = 549.7517, GNorm = 1.9944, lr_0 = 9.9782e-04
Validation auc = 0.706637
Epoch 3493
Loss = 3.6069e-02, PNorm = 549.8209, GNorm = 1.4697, lr_0 = 9.9782e-04
Validation auc = 0.711706
Epoch 3494
Loss = 1.5535e-02, PNorm = 549.8763, GNorm = 0.6171, lr_0 = 9.9782e-04
Validation auc = 0.711716
Epoch 3495
Loss = 6.8280e-02, PNorm = 549.9308, GNorm = 0.2095, lr_0 = 9.9782e-04
Validation auc = 0.711851
Epoch 3496
Loss = 3.9035e-02, PNorm = 549.9914, GNorm = 0.9367, lr_0 = 9.9781e-04
Validation auc = 0.708291
Epoch 3497
Loss = 3.1994e-02, PNorm = 550.0492, GNorm = 2.0950, lr_0 = 9.9781e-04
Validation auc = 0.703630
Epoch 3498
Loss = 3.1721e-02, PNorm = 550.1147, GNorm = 0.7159, lr_0 = 9.9781e-04
Validation auc = 0.702640
Epoch 3499
Loss = 2.4185e-02, PNorm = 550.1762, GNorm = 3.2713, lr_0 = 9.9781e-04
Loss = 5.2674e-02, PNorm = 550.2485, GNorm = 2.4112, lr_0 = 9.9781e-04
Validation auc = 0.707889
Epoch 3500
Loss = 3.3932e-02, PNorm = 550.3054, GNorm = 1.7336, lr_0 = 9.9781e-04
Validation auc = 0.713123
Epoch 3501
Loss = 1.1578e-01, PNorm = 550.3595, GNorm = 0.4287, lr_0 = 9.9781e-04
Validation auc = 0.716954
Epoch 3502
Loss = 6.4386e-02, PNorm = 550.4406, GNorm = 2.2903, lr_0 = 9.9781e-04
Validation auc = 0.711265
Epoch 3503
Loss = 5.7422e-02, PNorm = 550.5277, GNorm = 0.7922, lr_0 = 9.9781e-04
Validation auc = 0.712516
Epoch 3504
Loss = 5.2886e-02, PNorm = 550.5933, GNorm = 3.4895, lr_0 = 9.9781e-04
Validation auc = 0.718082
Epoch 3505
Loss = 3.8553e-02, PNorm = 550.6583, GNorm = 1.2034, lr_0 = 9.9781e-04
Validation auc = 0.719456
Epoch 3506
Loss = 6.8405e-02, PNorm = 550.7216, GNorm = 0.4578, lr_0 = 9.9781e-04
Validation auc = 0.712068
Epoch 3507
Loss = 2.4905e-02, PNorm = 550.7758, GNorm = 0.1557, lr_0 = 9.9781e-04
Validation auc = 0.709585
Epoch 3508
Loss = 1.0310e-01, PNorm = 550.8337, GNorm = 4.1678, lr_0 = 9.9781e-04
Validation auc = 0.712795
Epoch 3509
Loss = 4.0838e-02, PNorm = 550.9001, GNorm = 0.8904, lr_0 = 9.9781e-04
Loss = 2.3449e-02, PNorm = 550.9594, GNorm = 1.5911, lr_0 = 9.9780e-04
Validation auc = 0.707737
Epoch 3510
Loss = 5.6825e-02, PNorm = 551.0213, GNorm = 2.7317, lr_0 = 9.9780e-04
Validation auc = 0.702062
Epoch 3511
Loss = 2.6168e-02, PNorm = 551.0873, GNorm = 0.4230, lr_0 = 9.9780e-04
Validation auc = 0.697149
Epoch 3512
Loss = 6.0915e-02, PNorm = 551.1713, GNorm = 2.9353, lr_0 = 9.9780e-04
Validation auc = 0.711941
Epoch 3513
Loss = 1.2814e-01, PNorm = 551.2603, GNorm = 0.7672, lr_0 = 9.9780e-04
Validation auc = 0.713577
Epoch 3514
Loss = 2.5440e-02, PNorm = 551.3360, GNorm = 0.0310, lr_0 = 9.9780e-04
Validation auc = 0.710800
Epoch 3515
Loss = 3.9909e-02, PNorm = 551.3979, GNorm = 1.2431, lr_0 = 9.9780e-04
Validation auc = 0.711260
Epoch 3516
Loss = 8.5918e-02, PNorm = 551.4555, GNorm = 2.4799, lr_0 = 9.9780e-04
Validation auc = 0.705431
Epoch 3517
Loss = 7.6621e-02, PNorm = 551.5336, GNorm = 0.1982, lr_0 = 9.9780e-04
Validation auc = 0.704874
Epoch 3518
Loss = 2.5980e-02, PNorm = 551.6192, GNorm = 0.3197, lr_0 = 9.9780e-04
Validation auc = 0.704178
Epoch 3519
Loss = 3.0566e-02, PNorm = 551.6956, GNorm = 2.6154, lr_0 = 9.9780e-04
Loss = 8.6054e-02, PNorm = 551.7804, GNorm = 2.7495, lr_0 = 9.9780e-04
Validation auc = 0.722740
Epoch 3520
Loss = 7.0670e-02, PNorm = 551.9227, GNorm = 0.1633, lr_0 = 9.9780e-04
Validation auc = 0.717766
Epoch 3521
Loss = 6.1851e-02, PNorm = 552.0684, GNorm = 2.4339, lr_0 = 9.9780e-04
Validation auc = 0.729758
Epoch 3522
Loss = 6.1729e-02, PNorm = 552.2038, GNorm = 0.8014, lr_0 = 9.9780e-04
Validation auc = 0.724391
Epoch 3523
Loss = 1.2445e-01, PNorm = 552.3157, GNorm = 7.1282, lr_0 = 9.9779e-04
Validation auc = 0.719239
Epoch 3524
Loss = 6.6750e-02, PNorm = 552.4240, GNorm = 1.4721, lr_0 = 9.9779e-04
Validation auc = 0.719685
Epoch 3525
Loss = 6.8682e-02, PNorm = 552.5107, GNorm = 7.4121, lr_0 = 9.9779e-04
Validation auc = 0.711614
Epoch 3526
Loss = 2.5008e-02, PNorm = 552.6068, GNorm = 0.1989, lr_0 = 9.9779e-04
Validation auc = 0.714275
Epoch 3527
Loss = 1.0874e-02, PNorm = 552.6919, GNorm = 2.1303, lr_0 = 9.9779e-04
Validation auc = 0.715721
Epoch 3528
Loss = 2.2174e-02, PNorm = 552.7562, GNorm = 0.0885, lr_0 = 9.9779e-04
Validation auc = 0.713252
Epoch 3529
Loss = 1.2345e-02, PNorm = 552.8296, GNorm = 0.6580, lr_0 = 9.9779e-04
Loss = 4.2400e-02, PNorm = 552.8981, GNorm = 1.3007, lr_0 = 9.9779e-04
Validation auc = 0.700608
Epoch 3530
Loss = 3.4134e-02, PNorm = 552.9536, GNorm = 0.2924, lr_0 = 9.9779e-04
Validation auc = 0.696639
Epoch 3531
Loss = 4.5536e-02, PNorm = 553.0051, GNorm = 3.2163, lr_0 = 9.9779e-04
Validation auc = 0.695685
Epoch 3532
Loss = 5.2026e-02, PNorm = 553.0813, GNorm = 0.4171, lr_0 = 9.9779e-04
Validation auc = 0.695009
Epoch 3533
Loss = 6.7613e-02, PNorm = 553.1579, GNorm = 0.3900, lr_0 = 9.9779e-04
Validation auc = 0.705231
Epoch 3534
Loss = 2.9052e-02, PNorm = 553.2387, GNorm = 0.2205, lr_0 = 9.9779e-04
Validation auc = 0.712593
Epoch 3535
Loss = 4.8264e-02, PNorm = 553.3098, GNorm = 1.0721, lr_0 = 9.9779e-04
Validation auc = 0.716571
Epoch 3536
Loss = 7.4412e-02, PNorm = 553.3639, GNorm = 2.4507, lr_0 = 9.9778e-04
Validation auc = 0.718874
Epoch 3537
Loss = 6.1540e-02, PNorm = 553.4202, GNorm = 1.9863, lr_0 = 9.9778e-04
Validation auc = 0.710269
Epoch 3538
Loss = 4.8914e-02, PNorm = 553.4733, GNorm = 2.3924, lr_0 = 9.9778e-04
Validation auc = 0.706959
Epoch 3539
Loss = 1.1662e-02, PNorm = 553.5324, GNorm = 1.9049, lr_0 = 9.9778e-04
Loss = 5.3278e-02, PNorm = 553.5859, GNorm = 0.0965, lr_0 = 9.9778e-04
Validation auc = 0.708871
Epoch 3540
Loss = 6.4857e-02, PNorm = 553.6332, GNorm = 0.2084, lr_0 = 9.9778e-04
Validation auc = 0.707664
Epoch 3541
Loss = 2.6166e-02, PNorm = 553.6887, GNorm = 0.6496, lr_0 = 9.9778e-04
Validation auc = 0.705769
Epoch 3542
Loss = 6.2606e-02, PNorm = 553.7443, GNorm = 1.6807, lr_0 = 9.9778e-04
Validation auc = 0.704525
Epoch 3543
Loss = 6.8407e-02, PNorm = 553.8111, GNorm = 4.2938, lr_0 = 9.9778e-04
Validation auc = 0.707058
Epoch 3544
Loss = 7.5976e-02, PNorm = 553.8825, GNorm = 9.9285, lr_0 = 9.9778e-04
Validation auc = 0.714518
Epoch 3545
Loss = 5.3727e-02, PNorm = 553.9680, GNorm = 1.5471, lr_0 = 9.9778e-04
Validation auc = 0.723728
Epoch 3546
Loss = 5.3594e-02, PNorm = 554.0489, GNorm = 4.7258, lr_0 = 9.9778e-04
Validation auc = 0.704676
Epoch 3547
Loss = 1.3071e-01, PNorm = 554.1337, GNorm = 1.0009, lr_0 = 9.9778e-04
Validation auc = 0.696842
Epoch 3548
Loss = 2.7318e-01, PNorm = 554.2147, GNorm = 2.0765, lr_0 = 9.9778e-04
Validation auc = 0.701904
Epoch 3549
Loss = 2.4076e-02, PNorm = 554.2970, GNorm = 0.7668, lr_0 = 9.9778e-04
Loss = 4.6799e-02, PNorm = 554.3720, GNorm = 2.7528, lr_0 = 9.9777e-04
Validation auc = 0.717916
Epoch 3550
Loss = 2.4913e-02, PNorm = 554.4345, GNorm = 0.1839, lr_0 = 9.9777e-04
Validation auc = 0.729728
Epoch 3551
Loss = 6.9624e-02, PNorm = 554.4860, GNorm = 1.0543, lr_0 = 9.9777e-04
Validation auc = 0.730649
Epoch 3552
Loss = 9.3972e-02, PNorm = 554.5457, GNorm = 7.0873, lr_0 = 9.9777e-04
Validation auc = 0.733460
Epoch 3553
Loss = 1.1166e-01, PNorm = 554.6200, GNorm = 6.1406, lr_0 = 9.9777e-04
Validation auc = 0.720054
Epoch 3554
Loss = 9.8371e-02, PNorm = 554.7246, GNorm = 6.5273, lr_0 = 9.9777e-04
Validation auc = 0.716348
Epoch 3555
Loss = 6.0818e-02, PNorm = 554.8218, GNorm = 1.0965, lr_0 = 9.9777e-04
Validation auc = 0.721004
Epoch 3556
Loss = 8.4176e-02, PNorm = 554.9517, GNorm = 3.8883, lr_0 = 9.9777e-04
Validation auc = 0.721352
Epoch 3557
Loss = 9.0057e-02, PNorm = 555.0646, GNorm = 1.9903, lr_0 = 9.9777e-04
Validation auc = 0.711171
Epoch 3558
Loss = 8.7454e-02, PNorm = 555.1651, GNorm = 2.1205, lr_0 = 9.9777e-04
Validation auc = 0.699456
Epoch 3559
Loss = 5.8100e-03, PNorm = 555.2434, GNorm = 0.2677, lr_0 = 9.9777e-04
Loss = 4.4158e-02, PNorm = 555.2997, GNorm = 4.2249, lr_0 = 9.9777e-04
Validation auc = 0.701322
Epoch 3560
Loss = 5.8879e-02, PNorm = 555.3506, GNorm = 3.4540, lr_0 = 9.9777e-04
Validation auc = 0.700217
Epoch 3561
Loss = 3.8949e-02, PNorm = 555.3971, GNorm = 0.9536, lr_0 = 9.9777e-04
Validation auc = 0.702806
Epoch 3562
Loss = 2.5573e-02, PNorm = 555.4366, GNorm = 1.5087, lr_0 = 9.9776e-04
Validation auc = 0.708329
Epoch 3563
Loss = 8.2086e-02, PNorm = 555.4754, GNorm = 5.6589, lr_0 = 9.9776e-04
Validation auc = 0.713167
Epoch 3564
Loss = 4.3503e-02, PNorm = 555.5392, GNorm = 4.0772, lr_0 = 9.9776e-04
Validation auc = 0.712238
Epoch 3565
Loss = 3.2106e-02, PNorm = 555.6139, GNorm = 2.5378, lr_0 = 9.9776e-04
Validation auc = 0.706352
Epoch 3566
Loss = 6.6008e-02, PNorm = 555.6850, GNorm = 2.7737, lr_0 = 9.9776e-04
Validation auc = 0.709926
Epoch 3567
Loss = 6.5803e-02, PNorm = 555.7528, GNorm = 3.3189, lr_0 = 9.9776e-04
Validation auc = 0.713659
Epoch 3568
Loss = 2.0742e-02, PNorm = 555.8021, GNorm = 1.7214, lr_0 = 9.9776e-04
Validation auc = 0.720526
Epoch 3569
Loss = 5.9926e-03, PNorm = 555.8494, GNorm = 0.2267, lr_0 = 9.9776e-04
Loss = 2.9817e-02, PNorm = 555.9024, GNorm = 0.6289, lr_0 = 9.9776e-04
Validation auc = 0.724312
Epoch 3570
Loss = 5.3499e-02, PNorm = 555.9493, GNorm = 2.1313, lr_0 = 9.9776e-04
Validation auc = 0.718527
Epoch 3571
Loss = 7.2012e-02, PNorm = 555.9956, GNorm = 1.2675, lr_0 = 9.9776e-04
Validation auc = 0.723589
Epoch 3572
Loss = 5.0397e-02, PNorm = 556.0423, GNorm = 1.1254, lr_0 = 9.9776e-04
Validation auc = 0.723763
Epoch 3573
Loss = 2.1686e-02, PNorm = 556.0872, GNorm = 0.2095, lr_0 = 9.9776e-04
Validation auc = 0.723079
Epoch 3574
Loss = 6.8205e-02, PNorm = 556.1327, GNorm = 0.3780, lr_0 = 9.9776e-04
Validation auc = 0.721364
Epoch 3575
Loss = 1.6273e-02, PNorm = 556.1809, GNorm = 0.1996, lr_0 = 9.9776e-04
Validation auc = 0.723867
Epoch 3576
Loss = 5.3129e-03, PNorm = 556.2252, GNorm = 0.1189, lr_0 = 9.9775e-04
Validation auc = 0.722453
Epoch 3577
Loss = 3.7444e-02, PNorm = 556.2607, GNorm = 3.2610, lr_0 = 9.9775e-04
Validation auc = 0.722414
Epoch 3578
Loss = 1.0693e-01, PNorm = 556.3005, GNorm = 2.8756, lr_0 = 9.9775e-04
Validation auc = 0.725116
Epoch 3579
Loss = 8.9008e-03, PNorm = 556.3429, GNorm = 0.3738, lr_0 = 9.9775e-04
Loss = 8.6894e-02, PNorm = 556.3894, GNorm = 0.8051, lr_0 = 9.9775e-04
Validation auc = 0.723662
Epoch 3580
Loss = 1.5256e-02, PNorm = 556.4366, GNorm = 0.7368, lr_0 = 9.9775e-04
Validation auc = 0.721900
Epoch 3581
Loss = 2.8389e-02, PNorm = 556.4784, GNorm = 0.3055, lr_0 = 9.9775e-04
Validation auc = 0.722322
Epoch 3582
Loss = 4.4687e-02, PNorm = 556.5187, GNorm = 2.8003, lr_0 = 9.9775e-04
Validation auc = 0.725899
Epoch 3583
Loss = 3.1295e-02, PNorm = 556.5594, GNorm = 4.6385, lr_0 = 9.9775e-04
Validation auc = 0.725235
Epoch 3584
Loss = 2.5440e-02, PNorm = 556.6005, GNorm = 2.1990, lr_0 = 9.9775e-04
Validation auc = 0.729172
Epoch 3585
Loss = 1.4427e-02, PNorm = 556.6428, GNorm = 0.3556, lr_0 = 9.9775e-04
Validation auc = 0.731463
Epoch 3586
Loss = 8.0805e-02, PNorm = 556.6811, GNorm = 0.1947, lr_0 = 9.9775e-04
Validation auc = 0.730469
Epoch 3587
Loss = 7.6882e-02, PNorm = 556.7351, GNorm = 6.2512, lr_0 = 9.9775e-04
Validation auc = 0.730481
Epoch 3588
Loss = 8.8618e-03, PNorm = 556.7986, GNorm = 0.2136, lr_0 = 9.9775e-04
Validation auc = 0.728019
Epoch 3589
Loss = 9.3157e-02, PNorm = 556.8447, GNorm = 7.1792, lr_0 = 9.9774e-04
Loss = 6.5757e-02, PNorm = 556.9233, GNorm = 1.1780, lr_0 = 9.9774e-04
Validation auc = 0.704873
Epoch 3590
Loss = 4.8469e-02, PNorm = 557.0028, GNorm = 0.4902, lr_0 = 9.9774e-04
Validation auc = 0.700363
Epoch 3591
Loss = 6.6725e-02, PNorm = 557.0849, GNorm = 0.4597, lr_0 = 9.9774e-04
Validation auc = 0.712571
Epoch 3592
Loss = 5.1727e-02, PNorm = 557.1491, GNorm = 1.6818, lr_0 = 9.9774e-04
Validation auc = 0.705851
Epoch 3593
Loss = 8.5759e-02, PNorm = 557.1972, GNorm = 6.6591, lr_0 = 9.9774e-04
Validation auc = 0.706332
Epoch 3594
Loss = 3.7280e-02, PNorm = 557.2375, GNorm = 1.7081, lr_0 = 9.9774e-04
Validation auc = 0.712668
Epoch 3595
Loss = 3.8594e-02, PNorm = 557.2862, GNorm = 0.8319, lr_0 = 9.9774e-04
Validation auc = 0.714167
Epoch 3596
Loss = 6.3899e-02, PNorm = 557.3418, GNorm = 3.0807, lr_0 = 9.9774e-04
Validation auc = 0.721894
Epoch 3597
Loss = 4.2714e-02, PNorm = 557.4131, GNorm = 2.3287, lr_0 = 9.9774e-04
Validation auc = 0.730852
Epoch 3598
Loss = 6.1453e-02, PNorm = 557.4794, GNorm = 0.3066, lr_0 = 9.9774e-04
Validation auc = 0.738520
Epoch 3599
Loss = 8.7767e-04, PNorm = 557.5327, GNorm = 0.0512, lr_0 = 9.9774e-04
Loss = 2.9606e-02, PNorm = 557.5853, GNorm = 1.0528, lr_0 = 9.9774e-04
Validation auc = 0.733817
Epoch 3600
Loss = 5.1296e-02, PNorm = 557.6314, GNorm = 5.9071, lr_0 = 9.9774e-04
Validation auc = 0.737285
Epoch 3601
Loss = 5.2408e-02, PNorm = 557.6759, GNorm = 1.4436, lr_0 = 9.9774e-04
Validation auc = 0.738956
Epoch 3602
Loss = 7.3490e-02, PNorm = 557.7347, GNorm = 0.1641, lr_0 = 9.9773e-04
Validation auc = 0.728311
Epoch 3603
Loss = 6.8858e-02, PNorm = 557.8158, GNorm = 5.1383, lr_0 = 9.9773e-04
Validation auc = 0.730458
Epoch 3604
Loss = 7.7771e-02, PNorm = 557.8941, GNorm = 0.5414, lr_0 = 9.9773e-04
Validation auc = 0.719412
Epoch 3605
Loss = 4.7895e-02, PNorm = 557.9772, GNorm = 2.9513, lr_0 = 9.9773e-04
Validation auc = 0.720147
Epoch 3606
Loss = 3.2750e-02, PNorm = 558.0463, GNorm = 0.1733, lr_0 = 9.9773e-04
Validation auc = 0.725144
Epoch 3607
Loss = 3.6075e-02, PNorm = 558.0951, GNorm = 3.1002, lr_0 = 9.9773e-04
Validation auc = 0.720784
Epoch 3608
Loss = 1.0858e-01, PNorm = 558.1605, GNorm = 4.3039, lr_0 = 9.9773e-04
Validation auc = 0.713302
Epoch 3609
Loss = 5.5532e-03, PNorm = 558.2412, GNorm = 0.3417, lr_0 = 9.9773e-04
Loss = 6.2222e-02, PNorm = 558.2991, GNorm = 1.7888, lr_0 = 9.9773e-04
Validation auc = 0.712556
Epoch 3610
Loss = 4.1830e-02, PNorm = 558.3668, GNorm = 0.5046, lr_0 = 9.9773e-04
Validation auc = 0.713095
Epoch 3611
Loss = 5.8887e-02, PNorm = 558.4290, GNorm = 0.5042, lr_0 = 9.9773e-04
Validation auc = 0.717385
Epoch 3612
Loss = 7.5983e-02, PNorm = 558.4983, GNorm = 2.4117, lr_0 = 9.9773e-04
Validation auc = 0.731490
Epoch 3613
Loss = 3.8787e-02, PNorm = 558.5852, GNorm = 1.1792, lr_0 = 9.9773e-04
Validation auc = 0.736584
Epoch 3614
Loss = 5.9373e-02, PNorm = 558.6568, GNorm = 1.2599, lr_0 = 9.9773e-04
Validation auc = 0.710510
Epoch 3615
Loss = 9.2611e-02, PNorm = 558.7878, GNorm = 3.4539, lr_0 = 9.9772e-04
Validation auc = 0.703869
Epoch 3616
Loss = 1.3898e-01, PNorm = 558.9272, GNorm = 5.3116, lr_0 = 9.9772e-04
Validation auc = 0.705894
Epoch 3617
Loss = 5.4527e-02, PNorm = 559.0445, GNorm = 0.6793, lr_0 = 9.9772e-04
Validation auc = 0.714623
Epoch 3618
Loss = 3.8640e-02, PNorm = 559.1308, GNorm = 0.2347, lr_0 = 9.9772e-04
Validation auc = 0.726216
Epoch 3619
Loss = 4.0798e-02, PNorm = 559.2183, GNorm = 2.3896, lr_0 = 9.9772e-04
Loss = 8.4693e-02, PNorm = 559.3187, GNorm = 3.7985, lr_0 = 9.9772e-04
Validation auc = 0.720439
Epoch 3620
Loss = 6.9400e-02, PNorm = 559.4088, GNorm = 0.4913, lr_0 = 9.9772e-04
Validation auc = 0.720574
Epoch 3621
Loss = 7.6262e-02, PNorm = 559.5102, GNorm = 0.8570, lr_0 = 9.9772e-04
Validation auc = 0.726136
Epoch 3622
Loss = 1.9652e-02, PNorm = 559.6011, GNorm = 0.5194, lr_0 = 9.9772e-04
Validation auc = 0.737749
Epoch 3623
Loss = 2.7543e-02, PNorm = 559.6759, GNorm = 1.8914, lr_0 = 9.9772e-04
Validation auc = 0.746548
Epoch 3624
Loss = 7.0360e-02, PNorm = 559.7478, GNorm = 1.0045, lr_0 = 9.9772e-04
Validation auc = 0.738551
Epoch 3625
Loss = 2.9441e-02, PNorm = 559.8151, GNorm = 0.3271, lr_0 = 9.9772e-04
Validation auc = 0.743194
Epoch 3626
Loss = 6.0354e-03, PNorm = 559.8718, GNorm = 0.2756, lr_0 = 9.9772e-04
Validation auc = 0.736927
Epoch 3627
Loss = 1.1064e-01, PNorm = 559.9288, GNorm = 1.9132, lr_0 = 9.9772e-04
Validation auc = 0.720311
Epoch 3628
Loss = 4.1320e-02, PNorm = 560.0183, GNorm = 1.3671, lr_0 = 9.9772e-04
Validation auc = 0.723037
Epoch 3629
Loss = 2.4499e-01, PNorm = 560.1099, GNorm = 8.4812, lr_0 = 9.9771e-04
Loss = 3.7453e-02, PNorm = 560.1991, GNorm = 2.1926, lr_0 = 9.9771e-04
Validation auc = 0.732806
Epoch 3630
Loss = 6.8989e-02, PNorm = 560.2799, GNorm = 0.6080, lr_0 = 9.9771e-04
Validation auc = 0.734414
Epoch 3631
Loss = 1.2732e-01, PNorm = 560.3566, GNorm = 0.2155, lr_0 = 9.9771e-04
Validation auc = 0.723757
Epoch 3632
Loss = 7.6270e-02, PNorm = 560.4437, GNorm = 2.9314, lr_0 = 9.9771e-04
Validation auc = 0.725041
Epoch 3633
Loss = 2.3375e-02, PNorm = 560.5167, GNorm = 1.7924, lr_0 = 9.9771e-04
Validation auc = 0.722710
Epoch 3634
Loss = 3.6531e-02, PNorm = 560.5729, GNorm = 1.0915, lr_0 = 9.9771e-04
Validation auc = 0.725365
Epoch 3635
Loss = 1.3722e-01, PNorm = 560.6321, GNorm = 0.1837, lr_0 = 9.9771e-04
Validation auc = 0.724574
Epoch 3636
Loss = 4.8412e-02, PNorm = 560.7121, GNorm = 4.7937, lr_0 = 9.9771e-04
Validation auc = 0.736647
Epoch 3637
Loss = 1.2382e-01, PNorm = 560.8072, GNorm = 8.1923, lr_0 = 9.9771e-04
Validation auc = 0.735172
Epoch 3638
Loss = 1.2258e-01, PNorm = 560.9006, GNorm = 2.0389, lr_0 = 9.9771e-04
Validation auc = 0.724185
Epoch 3639
Loss = 1.3904e-01, PNorm = 560.9826, GNorm = 6.1988, lr_0 = 9.9771e-04
Loss = 3.1489e-02, PNorm = 561.0605, GNorm = 3.1040, lr_0 = 9.9771e-04
Validation auc = 0.726334
Epoch 3640
Loss = 7.5293e-02, PNorm = 561.1289, GNorm = 1.9964, lr_0 = 9.9771e-04
Validation auc = 0.721699
Epoch 3641
Loss = 3.3994e-02, PNorm = 561.1920, GNorm = 1.1021, lr_0 = 9.9771e-04
Validation auc = 0.715602
Epoch 3642
Loss = 9.6075e-02, PNorm = 561.2547, GNorm = 3.9699, lr_0 = 9.9770e-04
Validation auc = 0.712370
Epoch 3643
Loss = 6.4950e-02, PNorm = 561.3147, GNorm = 0.0562, lr_0 = 9.9770e-04
Validation auc = 0.717780
Epoch 3644
Loss = 2.2743e-02, PNorm = 561.3809, GNorm = 0.2965, lr_0 = 9.9770e-04
Validation auc = 0.723455
Epoch 3645
Loss = 1.9402e-02, PNorm = 561.4432, GNorm = 0.6411, lr_0 = 9.9770e-04
Validation auc = 0.725537
Epoch 3646
Loss = 2.2760e-02, PNorm = 561.4999, GNorm = 0.9065, lr_0 = 9.9770e-04
Validation auc = 0.728583
Epoch 3647
Loss = 4.4837e-03, PNorm = 561.5611, GNorm = 0.2415, lr_0 = 9.9770e-04
Validation auc = 0.722436
Epoch 3648
Loss = 2.9904e-02, PNorm = 561.6383, GNorm = 1.4553, lr_0 = 9.9770e-04
Validation auc = 0.698652
Epoch 3649
Loss = 8.0374e-03, PNorm = 561.7486, GNorm = 0.3830, lr_0 = 9.9770e-04
Loss = 6.5197e-02, PNorm = 561.8385, GNorm = 1.3851, lr_0 = 9.9770e-04
Validation auc = 0.689142
Epoch 3650
Loss = 4.1636e-02, PNorm = 561.9346, GNorm = 1.5396, lr_0 = 9.9770e-04
Validation auc = 0.700796
Epoch 3651
Loss = 6.1184e-02, PNorm = 562.0185, GNorm = 5.8056, lr_0 = 9.9770e-04
Validation auc = 0.709217
Epoch 3652
Loss = 5.1374e-02, PNorm = 562.0939, GNorm = 0.3011, lr_0 = 9.9770e-04
Validation auc = 0.715752
Epoch 3653
Loss = 8.1179e-02, PNorm = 562.1687, GNorm = 4.2885, lr_0 = 9.9770e-04
Validation auc = 0.711428
Epoch 3654
Loss = 5.1163e-02, PNorm = 562.2598, GNorm = 0.6906, lr_0 = 9.9770e-04
Validation auc = 0.709318
Epoch 3655
Loss = 4.5486e-02, PNorm = 562.3299, GNorm = 4.0174, lr_0 = 9.9769e-04
Validation auc = 0.709056
Epoch 3656
Loss = 8.7202e-02, PNorm = 562.3846, GNorm = 1.0393, lr_0 = 9.9769e-04
Validation auc = 0.705757
Epoch 3657
Loss = 1.7056e-02, PNorm = 562.4334, GNorm = 0.4282, lr_0 = 9.9769e-04
Validation auc = 0.704574
Epoch 3658
Loss = 3.8967e-02, PNorm = 562.4790, GNorm = 0.9199, lr_0 = 9.9769e-04
Validation auc = 0.716465
Epoch 3659
Loss = 1.6270e-01, PNorm = 562.5329, GNorm = 8.4469, lr_0 = 9.9769e-04
Loss = 6.3887e-02, PNorm = 562.6006, GNorm = 0.9020, lr_0 = 9.9769e-04
Validation auc = 0.724504
Epoch 3660
Loss = 3.2302e-02, PNorm = 562.6680, GNorm = 3.2381, lr_0 = 9.9769e-04
Validation auc = 0.730566
Epoch 3661
Loss = 2.1410e-02, PNorm = 562.7322, GNorm = 1.1558, lr_0 = 9.9769e-04
Validation auc = 0.732603
Epoch 3662
Loss = 4.6317e-02, PNorm = 562.7866, GNorm = 1.3118, lr_0 = 9.9769e-04
Validation auc = 0.732224
Epoch 3663
Loss = 1.0011e-01, PNorm = 562.8554, GNorm = 1.8705, lr_0 = 9.9769e-04
Validation auc = 0.724374
Epoch 3664
Loss = 1.8023e-02, PNorm = 562.9363, GNorm = 1.1341, lr_0 = 9.9769e-04
Validation auc = 0.711370
Epoch 3665
Loss = 1.7196e-02, PNorm = 563.0093, GNorm = 1.1816, lr_0 = 9.9769e-04
Validation auc = 0.711392
Epoch 3666
Loss = 6.8096e-02, PNorm = 563.0555, GNorm = 0.0696, lr_0 = 9.9769e-04
Validation auc = 0.716404
Epoch 3667
Loss = 5.0336e-02, PNorm = 563.1019, GNorm = 6.3168, lr_0 = 9.9769e-04
Validation auc = 0.729554
Epoch 3668
Loss = 6.0620e-03, PNorm = 563.1634, GNorm = 0.7355, lr_0 = 9.9769e-04
Validation auc = 0.728211
Epoch 3669
Loss = 4.1372e-02, PNorm = 563.2715, GNorm = 1.1945, lr_0 = 9.9768e-04
Loss = 6.9182e-02, PNorm = 563.3860, GNorm = 1.8775, lr_0 = 9.9768e-04
Validation auc = 0.719317
Epoch 3670
Loss = 8.2822e-02, PNorm = 563.4687, GNorm = 2.0875, lr_0 = 9.9768e-04
Validation auc = 0.719650
Epoch 3671
Loss = 4.3573e-02, PNorm = 563.5355, GNorm = 0.6488, lr_0 = 9.9768e-04
Validation auc = 0.717553
Epoch 3672
Loss = 4.0033e-02, PNorm = 563.5834, GNorm = 1.6926, lr_0 = 9.9768e-04
Validation auc = 0.717136
Epoch 3673
Loss = 3.1322e-02, PNorm = 563.6286, GNorm = 0.6628, lr_0 = 9.9768e-04
Validation auc = 0.713869
Epoch 3674
Loss = 4.1734e-02, PNorm = 563.6700, GNorm = 1.2636, lr_0 = 9.9768e-04
Validation auc = 0.713246
Epoch 3675
Loss = 4.4692e-02, PNorm = 563.7110, GNorm = 3.1478, lr_0 = 9.9768e-04
Validation auc = 0.717083
Epoch 3676
Loss = 8.0465e-02, PNorm = 563.7479, GNorm = 14.3320, lr_0 = 9.9768e-04
Validation auc = 0.710761
Epoch 3677
Loss = 2.7964e-02, PNorm = 563.7979, GNorm = 0.6452, lr_0 = 9.9768e-04
Validation auc = 0.709753
Epoch 3678
Loss = 2.2408e-02, PNorm = 563.8465, GNorm = 5.1200, lr_0 = 9.9768e-04
Validation auc = 0.709305
Epoch 3679
Loss = 8.3881e-03, PNorm = 563.8990, GNorm = 0.3316, lr_0 = 9.9768e-04
Loss = 3.2128e-02, PNorm = 563.9536, GNorm = 2.6474, lr_0 = 9.9768e-04
Validation auc = 0.708658
Epoch 3680
Loss = 3.1684e-02, PNorm = 564.0100, GNorm = 7.9502, lr_0 = 9.9768e-04
Validation auc = 0.706354
Epoch 3681
Loss = 8.7489e-02, PNorm = 564.0913, GNorm = 2.5881, lr_0 = 9.9767e-04
Validation auc = 0.709514
Epoch 3682
Loss = 5.1517e-02, PNorm = 564.1787, GNorm = 0.6569, lr_0 = 9.9767e-04
Validation auc = 0.708119
Epoch 3683
Loss = 9.9577e-02, PNorm = 564.2803, GNorm = 3.2406, lr_0 = 9.9767e-04
Validation auc = 0.701202
Epoch 3684
Loss = 6.8058e-02, PNorm = 564.3790, GNorm = 1.3478, lr_0 = 9.9767e-04
Validation auc = 0.699918
Epoch 3685
Loss = 2.0373e-02, PNorm = 564.4522, GNorm = 2.6189, lr_0 = 9.9767e-04
Validation auc = 0.709602
Epoch 3686
Loss = 2.9043e-02, PNorm = 564.5121, GNorm = 0.1164, lr_0 = 9.9767e-04
Validation auc = 0.707162
Epoch 3687
Loss = 6.4575e-02, PNorm = 564.5703, GNorm = 0.4379, lr_0 = 9.9767e-04
Validation auc = 0.697281
Epoch 3688
Loss = 2.0115e-01, PNorm = 564.6249, GNorm = 14.8189, lr_0 = 9.9767e-04
Validation auc = 0.659037
Epoch 3689
Loss = 3.6199e-02, PNorm = 564.7182, GNorm = 1.0619, lr_0 = 9.9767e-04
Loss = 8.8722e-02, PNorm = 564.7989, GNorm = 8.7971, lr_0 = 9.9767e-04
Validation auc = 0.660968
Epoch 3690
Loss = 3.0521e-02, PNorm = 564.8744, GNorm = 1.2526, lr_0 = 9.9767e-04
Validation auc = 0.684343
Epoch 3691
Loss = 6.9190e-02, PNorm = 564.9301, GNorm = 4.4343, lr_0 = 9.9767e-04
Validation auc = 0.703663
Epoch 3692
Loss = 6.2355e-02, PNorm = 564.9893, GNorm = 1.4032, lr_0 = 9.9767e-04
Validation auc = 0.709144
Epoch 3693
Loss = 2.9853e-02, PNorm = 565.0523, GNorm = 3.0141, lr_0 = 9.9767e-04
Validation auc = 0.705263
Epoch 3694
Loss = 5.1519e-02, PNorm = 565.1085, GNorm = 8.1816, lr_0 = 9.9767e-04
Validation auc = 0.706015
Epoch 3695
Loss = 2.4503e-02, PNorm = 565.1686, GNorm = 2.5651, lr_0 = 9.9766e-04
Validation auc = 0.707848
Epoch 3696
Loss = 3.3225e-02, PNorm = 565.2241, GNorm = 0.8937, lr_0 = 9.9766e-04
Validation auc = 0.705296
Epoch 3697
Loss = 3.1883e-02, PNorm = 565.2890, GNorm = 2.5779, lr_0 = 9.9766e-04
Validation auc = 0.695994
Epoch 3698
Loss = 2.1330e-02, PNorm = 565.3418, GNorm = 0.2954, lr_0 = 9.9766e-04
Validation auc = 0.691897
Epoch 3699
Loss = 1.9701e-02, PNorm = 565.3853, GNorm = 1.5783, lr_0 = 9.9766e-04
Loss = 3.5792e-02, PNorm = 565.4278, GNorm = 0.1779, lr_0 = 9.9766e-04
Validation auc = 0.685296
Epoch 3700
Loss = 6.2714e-02, PNorm = 565.4837, GNorm = 1.1279, lr_0 = 9.9766e-04
Validation auc = 0.684505
Epoch 3701
Loss = 4.9335e-02, PNorm = 565.5557, GNorm = 0.4971, lr_0 = 9.9766e-04
Validation auc = 0.695134
Epoch 3702
Loss = 3.3239e-02, PNorm = 565.6124, GNorm = 1.4813, lr_0 = 9.9766e-04
Validation auc = 0.699290
Epoch 3703
Loss = 1.1833e-02, PNorm = 565.6535, GNorm = 0.2236, lr_0 = 9.9766e-04
Validation auc = 0.696450
Epoch 3704
Loss = 3.5721e-02, PNorm = 565.6876, GNorm = 0.2366, lr_0 = 9.9766e-04
Validation auc = 0.698415
Epoch 3705
Loss = 7.2610e-02, PNorm = 565.7297, GNorm = 0.1919, lr_0 = 9.9766e-04
Validation auc = 0.704518
Epoch 3706
Loss = 3.6139e-02, PNorm = 565.7978, GNorm = 1.4471, lr_0 = 9.9766e-04
Validation auc = 0.711933
Epoch 3707
Loss = 8.8814e-02, PNorm = 565.8825, GNorm = 7.0578, lr_0 = 9.9766e-04
Validation auc = 0.720068
Epoch 3708
Loss = 4.3467e-02, PNorm = 565.9792, GNorm = 2.2759, lr_0 = 9.9765e-04
Validation auc = 0.720992
Epoch 3709
Loss = 6.4580e-02, PNorm = 566.0611, GNorm = 2.0413, lr_0 = 9.9765e-04
Loss = 3.6587e-02, PNorm = 566.1364, GNorm = 0.2344, lr_0 = 9.9765e-04
Validation auc = 0.717013
Epoch 3710
Loss = 7.6903e-02, PNorm = 566.2010, GNorm = 1.9377, lr_0 = 9.9765e-04
Validation auc = 0.719947
Epoch 3711
Loss = 5.4504e-02, PNorm = 566.2900, GNorm = 0.5612, lr_0 = 9.9765e-04
Validation auc = 0.717193
Epoch 3712
Loss = 7.3103e-02, PNorm = 566.3681, GNorm = 8.3676, lr_0 = 9.9765e-04
Validation auc = 0.710841
Epoch 3713
Loss = 6.2597e-02, PNorm = 566.4545, GNorm = 1.8155, lr_0 = 9.9765e-04
Validation auc = 0.703938
Epoch 3714
Loss = 6.1253e-02, PNorm = 566.5177, GNorm = 5.1844, lr_0 = 9.9765e-04
Validation auc = 0.702133
Epoch 3715
Loss = 3.1484e-02, PNorm = 566.5652, GNorm = 1.1020, lr_0 = 9.9765e-04
Validation auc = 0.699903
Epoch 3716
Loss = 1.1378e-01, PNorm = 566.6058, GNorm = 0.8209, lr_0 = 9.9765e-04
Validation auc = 0.706907
Epoch 3717
Loss = 3.6093e-02, PNorm = 566.6647, GNorm = 2.8956, lr_0 = 9.9765e-04
Validation auc = 0.708121
Epoch 3718
Loss = 1.0497e-02, PNorm = 566.7169, GNorm = 0.1166, lr_0 = 9.9765e-04
Validation auc = 0.709746
Epoch 3719
Loss = 1.4577e-01, PNorm = 566.7657, GNorm = 2.2932, lr_0 = 9.9765e-04
Loss = 9.1000e-02, PNorm = 566.8350, GNorm = 8.1462, lr_0 = 9.9765e-04
Validation auc = 0.714028
Epoch 3720
Loss = 5.0176e-02, PNorm = 566.9199, GNorm = 1.3444, lr_0 = 9.9765e-04
Validation auc = 0.723349
Epoch 3721
Loss = 8.5972e-02, PNorm = 566.9924, GNorm = 0.2893, lr_0 = 9.9764e-04
Validation auc = 0.721054
Epoch 3722
Loss = 4.8836e-02, PNorm = 567.0596, GNorm = 1.7430, lr_0 = 9.9764e-04
Validation auc = 0.716526
Epoch 3723
Loss = 3.6242e-02, PNorm = 567.1220, GNorm = 1.0359, lr_0 = 9.9764e-04
Validation auc = 0.711763
Epoch 3724
Loss = 4.5831e-02, PNorm = 567.2053, GNorm = 0.5464, lr_0 = 9.9764e-04
Validation auc = 0.709529
Epoch 3725
Loss = 4.1987e-02, PNorm = 567.2953, GNorm = 0.7689, lr_0 = 9.9764e-04
Validation auc = 0.712737
Epoch 3726
Loss = 1.3206e-01, PNorm = 567.3778, GNorm = 4.0043, lr_0 = 9.9764e-04
Validation auc = 0.710507
Epoch 3727
Loss = 5.7905e-02, PNorm = 567.4720, GNorm = 0.3770, lr_0 = 9.9764e-04
Validation auc = 0.701839
Epoch 3728
Loss = 1.9115e-02, PNorm = 567.5635, GNorm = 1.5178, lr_0 = 9.9764e-04
Validation auc = 0.704760
Epoch 3729
Loss = 2.0971e-01, PNorm = 567.6301, GNorm = 4.9022, lr_0 = 9.9764e-04
Loss = 5.6222e-02, PNorm = 567.6917, GNorm = 0.1402, lr_0 = 9.9764e-04
Validation auc = 0.704542
Epoch 3730
Loss = 2.9915e-02, PNorm = 567.7590, GNorm = 0.3181, lr_0 = 9.9764e-04
Validation auc = 0.704286
Epoch 3731
Loss = 5.9324e-02, PNorm = 567.8202, GNorm = 0.7873, lr_0 = 9.9764e-04
Validation auc = 0.703599
Epoch 3732
Loss = 3.1620e-02, PNorm = 567.8841, GNorm = 0.3517, lr_0 = 9.9764e-04
Validation auc = 0.711685
Epoch 3733
Loss = 7.0905e-02, PNorm = 567.9359, GNorm = 2.7010, lr_0 = 9.9764e-04
Validation auc = 0.715627
Epoch 3734
Loss = 4.7535e-02, PNorm = 567.9955, GNorm = 0.0766, lr_0 = 9.9763e-04
Validation auc = 0.723594
Epoch 3735
Loss = 1.9539e-02, PNorm = 568.0544, GNorm = 0.4898, lr_0 = 9.9763e-04
Validation auc = 0.721502
Epoch 3736
Loss = 1.1449e-01, PNorm = 568.1038, GNorm = 2.2046, lr_0 = 9.9763e-04
Validation auc = 0.719293
Epoch 3737
Loss = 8.4457e-02, PNorm = 568.1686, GNorm = 2.5376, lr_0 = 9.9763e-04
Validation auc = 0.707051
Epoch 3738
Loss = 2.6572e-02, PNorm = 568.2535, GNorm = 0.4135, lr_0 = 9.9763e-04
Validation auc = 0.708045
Epoch 3739
Loss = 1.7190e-02, PNorm = 568.3257, GNorm = 1.0633, lr_0 = 9.9763e-04
Loss = 4.6667e-02, PNorm = 568.3804, GNorm = 0.7721, lr_0 = 9.9763e-04
Validation auc = 0.703996
Epoch 3740
Loss = 1.4411e-01, PNorm = 568.4581, GNorm = 2.0280, lr_0 = 9.9763e-04
Validation auc = 0.686418
Epoch 3741
Loss = 5.2480e-02, PNorm = 568.5443, GNorm = 3.8881, lr_0 = 9.9763e-04
Validation auc = 0.680227
Epoch 3742
Loss = 4.7763e-02, PNorm = 568.6297, GNorm = 2.7738, lr_0 = 9.9763e-04
Validation auc = 0.683635
Epoch 3743
Loss = 7.1587e-02, PNorm = 568.7119, GNorm = 3.6975, lr_0 = 9.9763e-04
Validation auc = 0.691663
Epoch 3744
Loss = 1.7482e-02, PNorm = 568.7783, GNorm = 0.8622, lr_0 = 9.9763e-04
Validation auc = 0.692357
Epoch 3745
Loss = 3.1266e-02, PNorm = 568.8284, GNorm = 2.2222, lr_0 = 9.9763e-04
Validation auc = 0.695082
Epoch 3746
Loss = 3.5573e-02, PNorm = 568.8747, GNorm = 3.1726, lr_0 = 9.9763e-04
Validation auc = 0.699933
Epoch 3747
Loss = 8.4164e-02, PNorm = 568.9219, GNorm = 1.8736, lr_0 = 9.9763e-04
Validation auc = 0.693753
Epoch 3748
Loss = 9.0424e-02, PNorm = 568.9883, GNorm = 0.8653, lr_0 = 9.9762e-04
Validation auc = 0.690926
Epoch 3749
Loss = 4.7520e-02, PNorm = 569.0615, GNorm = 2.0778, lr_0 = 9.9762e-04
Loss = 7.9081e-02, PNorm = 569.1314, GNorm = 1.6239, lr_0 = 9.9762e-04
Validation auc = 0.692904
Epoch 3750
Loss = 5.0484e-02, PNorm = 569.1998, GNorm = 3.5582, lr_0 = 9.9762e-04
Validation auc = 0.691402
Epoch 3751
Loss = 4.0473e-02, PNorm = 569.2707, GNorm = 0.7072, lr_0 = 9.9762e-04
Validation auc = 0.695015
Epoch 3752
Loss = 1.1318e-01, PNorm = 569.3337, GNorm = 7.9530, lr_0 = 9.9762e-04
Validation auc = 0.689647
Epoch 3753
Loss = 8.0347e-02, PNorm = 569.4153, GNorm = 1.0589, lr_0 = 9.9762e-04
Validation auc = 0.684588
Epoch 3754
Loss = 1.7389e-02, PNorm = 569.4856, GNorm = 0.7814, lr_0 = 9.9762e-04
Validation auc = 0.687980
Epoch 3755
Loss = 4.0459e-02, PNorm = 569.5452, GNorm = 0.7743, lr_0 = 9.9762e-04
Validation auc = 0.690799
Epoch 3756
Loss = 1.7378e-01, PNorm = 569.6110, GNorm = 5.5737, lr_0 = 9.9762e-04
Validation auc = 0.686861
Epoch 3757
Loss = 1.8471e-02, PNorm = 569.6982, GNorm = 0.5900, lr_0 = 9.9762e-04
Validation auc = 0.682202
Epoch 3758
Loss = 1.2933e-02, PNorm = 569.7854, GNorm = 0.1443, lr_0 = 9.9762e-04
Validation auc = 0.684763
Epoch 3759
Loss = 6.4869e-01, PNorm = 569.8666, GNorm = 11.9902, lr_0 = 9.9762e-04
Loss = 3.4423e-02, PNorm = 569.9388, GNorm = 0.7975, lr_0 = 9.9762e-04
Validation auc = 0.704004
Epoch 3760
Loss = 4.4984e-02, PNorm = 570.0053, GNorm = 5.9264, lr_0 = 9.9762e-04
Validation auc = 0.711657
Epoch 3761
Loss = 4.4573e-02, PNorm = 570.0661, GNorm = 1.3105, lr_0 = 9.9761e-04
Validation auc = 0.717975
Epoch 3762
Loss = 2.7111e-02, PNorm = 570.1240, GNorm = 2.1914, lr_0 = 9.9761e-04
Validation auc = 0.722287
Epoch 3763
Loss = 8.6741e-03, PNorm = 570.1741, GNorm = 0.4397, lr_0 = 9.9761e-04
Validation auc = 0.725215
Epoch 3764
Loss = 9.0907e-02, PNorm = 570.2238, GNorm = 3.3460, lr_0 = 9.9761e-04
Validation auc = 0.729498
Epoch 3765
Loss = 4.5877e-02, PNorm = 570.3131, GNorm = 4.2302, lr_0 = 9.9761e-04
Validation auc = 0.712465
Epoch 3766
Loss = 4.2489e-02, PNorm = 570.4135, GNorm = 1.3558, lr_0 = 9.9761e-04
Validation auc = 0.694583
Epoch 3767
Loss = 3.4294e-01, PNorm = 570.5138, GNorm = 0.8804, lr_0 = 9.9761e-04
Validation auc = 0.686220
Epoch 3768
Loss = 1.2138e-01, PNorm = 570.6118, GNorm = 1.4242, lr_0 = 9.9761e-04
Validation auc = 0.679776
Epoch 3769
Loss = 7.2735e-02, PNorm = 570.7023, GNorm = 1.5001, lr_0 = 9.9761e-04
Loss = 4.3853e-02, PNorm = 570.7874, GNorm = 0.5020, lr_0 = 9.9761e-04
Validation auc = 0.684509
Epoch 3770
Loss = 3.7474e-02, PNorm = 570.8602, GNorm = 0.4374, lr_0 = 9.9761e-04
Validation auc = 0.698166
Epoch 3771
Loss = 5.9363e-02, PNorm = 570.9151, GNorm = 3.8460, lr_0 = 9.9761e-04
Validation auc = 0.702162
Epoch 3772
Loss = 3.2585e-02, PNorm = 570.9675, GNorm = 0.3140, lr_0 = 9.9761e-04
Validation auc = 0.701978
Epoch 3773
Loss = 4.5374e-02, PNorm = 571.0136, GNorm = 1.8759, lr_0 = 9.9761e-04
Validation auc = 0.699964
Epoch 3774
Loss = 2.1213e-02, PNorm = 571.0486, GNorm = 0.0760, lr_0 = 9.9760e-04
Validation auc = 0.701816
Epoch 3775
Loss = 1.0962e-02, PNorm = 571.0828, GNorm = 0.3269, lr_0 = 9.9760e-04
Validation auc = 0.713215
Epoch 3776
Loss = 3.6299e-02, PNorm = 571.1192, GNorm = 0.2994, lr_0 = 9.9760e-04
Validation auc = 0.714737
Epoch 3777
Loss = 5.0690e-02, PNorm = 571.1680, GNorm = 0.1487, lr_0 = 9.9760e-04
Validation auc = 0.717209
Epoch 3778
Loss = 4.9073e-02, PNorm = 571.2262, GNorm = 1.8431, lr_0 = 9.9760e-04
Validation auc = 0.719277
Epoch 3779
Loss = 1.1494e-02, PNorm = 571.2769, GNorm = 0.3381, lr_0 = 9.9760e-04
Loss = 5.3922e-02, PNorm = 571.3339, GNorm = 0.3413, lr_0 = 9.9760e-04
Validation auc = 0.718095
Epoch 3780
Loss = 6.8612e-02, PNorm = 571.4080, GNorm = 0.1206, lr_0 = 9.9760e-04
Validation auc = 0.709979
Epoch 3781
Loss = 4.1062e-02, PNorm = 571.4727, GNorm = 0.2579, lr_0 = 9.9760e-04
Validation auc = 0.708163
Epoch 3782
Loss = 3.7753e-02, PNorm = 571.5271, GNorm = 4.9114, lr_0 = 9.9760e-04
Validation auc = 0.704830
Epoch 3783
Loss = 4.2855e-02, PNorm = 571.5921, GNorm = 5.7603, lr_0 = 9.9760e-04
Validation auc = 0.705487
Epoch 3784
Loss = 1.0548e-02, PNorm = 571.6635, GNorm = 0.1120, lr_0 = 9.9760e-04
Validation auc = 0.708865
Epoch 3785
Loss = 1.0574e-01, PNorm = 571.7278, GNorm = 0.4921, lr_0 = 9.9760e-04
Validation auc = 0.719375
Epoch 3786
Loss = 6.9072e-02, PNorm = 571.7906, GNorm = 1.0502, lr_0 = 9.9760e-04
Validation auc = 0.710975
Epoch 3787
Loss = 5.4569e-02, PNorm = 571.8517, GNorm = 0.3816, lr_0 = 9.9760e-04
Validation auc = 0.710782
Epoch 3788
Loss = 8.6834e-02, PNorm = 571.9118, GNorm = 0.6649, lr_0 = 9.9759e-04
Validation auc = 0.713090
Epoch 3789
Loss = 7.0993e-03, PNorm = 571.9648, GNorm = 0.3077, lr_0 = 9.9759e-04
Loss = 3.2715e-02, PNorm = 572.0268, GNorm = 2.2609, lr_0 = 9.9759e-04
Validation auc = 0.705118
Epoch 3790
Loss = 6.0455e-02, PNorm = 572.0823, GNorm = 0.3562, lr_0 = 9.9759e-04
Validation auc = 0.696021
Epoch 3791
Loss = 6.0151e-02, PNorm = 572.1569, GNorm = 0.3887, lr_0 = 9.9759e-04
Validation auc = 0.694616
Epoch 3792
Loss = 4.9373e-02, PNorm = 572.2222, GNorm = 0.8360, lr_0 = 9.9759e-04
Validation auc = 0.703103
Epoch 3793
Loss = 4.8270e-02, PNorm = 572.2792, GNorm = 0.5365, lr_0 = 9.9759e-04
Validation auc = 0.696933
Epoch 3794
Loss = 4.8495e-02, PNorm = 572.3365, GNorm = 0.6883, lr_0 = 9.9759e-04
Validation auc = 0.702640
Epoch 3795
Loss = 4.2711e-02, PNorm = 572.3878, GNorm = 3.4724, lr_0 = 9.9759e-04
Validation auc = 0.710044
Epoch 3796
Loss = 3.5106e-02, PNorm = 572.4406, GNorm = 0.7926, lr_0 = 9.9759e-04
Validation auc = 0.716336
Epoch 3797
Loss = 7.5424e-02, PNorm = 572.4913, GNorm = 3.2925, lr_0 = 9.9759e-04
Validation auc = 0.726584
Epoch 3798
Loss = 5.0051e-02, PNorm = 572.5345, GNorm = 0.4424, lr_0 = 9.9759e-04
Validation auc = 0.728062
Epoch 3799
Loss = 1.7715e-02, PNorm = 572.5764, GNorm = 0.8551, lr_0 = 9.9759e-04
Loss = 1.2777e-01, PNorm = 572.6378, GNorm = 3.0561, lr_0 = 9.9759e-04
Validation auc = 0.718792
Epoch 3800
Loss = 1.8028e-01, PNorm = 572.7180, GNorm = 0.8691, lr_0 = 9.9758e-04
Validation auc = 0.699818
Epoch 3801
Loss = 8.4955e-02, PNorm = 572.8184, GNorm = 1.3089, lr_0 = 9.9758e-04
Validation auc = 0.671329
Epoch 3802
Loss = 4.8689e-02, PNorm = 572.9036, GNorm = 1.7213, lr_0 = 9.9758e-04
Validation auc = 0.671890
Epoch 3803
Loss = 4.9903e-02, PNorm = 572.9744, GNorm = 0.7360, lr_0 = 9.9758e-04
Validation auc = 0.681734
Epoch 3804
Loss = 6.8283e-02, PNorm = 573.0314, GNorm = 3.3630, lr_0 = 9.9758e-04
Validation auc = 0.687114
Epoch 3805
Loss = 1.2681e-01, PNorm = 573.0882, GNorm = 1.2699, lr_0 = 9.9758e-04
Validation auc = 0.689979
Epoch 3806
Loss = 5.8369e-02, PNorm = 573.1564, GNorm = 3.1870, lr_0 = 9.9758e-04
Validation auc = 0.693896
Epoch 3807
Loss = 2.7706e-02, PNorm = 573.2204, GNorm = 1.3305, lr_0 = 9.9758e-04
Validation auc = 0.687801
Epoch 3808
Loss = 1.3632e-01, PNorm = 573.2990, GNorm = 10.2469, lr_0 = 9.9758e-04
Validation auc = 0.705714
Epoch 3809
Loss = 2.5035e-01, PNorm = 573.3863, GNorm = 4.4118, lr_0 = 9.9758e-04
Loss = 6.6748e-02, PNorm = 573.4497, GNorm = 5.5879, lr_0 = 9.9758e-04
Validation auc = 0.708345
Epoch 3810
Loss = 4.4800e-02, PNorm = 573.5155, GNorm = 3.3929, lr_0 = 9.9758e-04
Validation auc = 0.701805
Epoch 3811
Loss = 5.9953e-02, PNorm = 573.5742, GNorm = 7.0880, lr_0 = 9.9758e-04
Validation auc = 0.695627
Epoch 3812
Loss = 2.4985e-02, PNorm = 573.6308, GNorm = 1.4322, lr_0 = 9.9758e-04
Validation auc = 0.689925
Epoch 3813
Loss = 6.8545e-02, PNorm = 573.6885, GNorm = 1.1442, lr_0 = 9.9758e-04
Validation auc = 0.684370
Epoch 3814
Loss = 6.4172e-02, PNorm = 573.7506, GNorm = 0.6729, lr_0 = 9.9757e-04
Validation auc = 0.682040
Epoch 3815
Loss = 4.3615e-02, PNorm = 573.8048, GNorm = 1.1792, lr_0 = 9.9757e-04
Validation auc = 0.688313
Epoch 3816
Loss = 5.5554e-02, PNorm = 573.8542, GNorm = 2.4925, lr_0 = 9.9757e-04
Validation auc = 0.686858
Epoch 3817
Loss = 5.3335e-02, PNorm = 573.9097, GNorm = 0.5308, lr_0 = 9.9757e-04
Validation auc = 0.688935
Epoch 3818
Loss = 1.0463e-01, PNorm = 573.9681, GNorm = 2.3186, lr_0 = 9.9757e-04
Validation auc = 0.698191
Epoch 3819
Loss = 4.7052e-03, PNorm = 574.0379, GNorm = 0.2767, lr_0 = 9.9757e-04
Loss = 4.6081e-02, PNorm = 574.1033, GNorm = 0.3649, lr_0 = 9.9757e-04
Validation auc = 0.701479
Epoch 3820
Loss = 6.8525e-02, PNorm = 574.1660, GNorm = 2.4438, lr_0 = 9.9757e-04
Validation auc = 0.699023
Epoch 3821
Loss = 2.6060e-02, PNorm = 574.2329, GNorm = 0.1642, lr_0 = 9.9757e-04
Validation auc = 0.697546
Epoch 3822
Loss = 3.5052e-02, PNorm = 574.2834, GNorm = 0.3240, lr_0 = 9.9757e-04
Validation auc = 0.695708
Epoch 3823
Loss = 3.2842e-02, PNorm = 574.3277, GNorm = 0.0932, lr_0 = 9.9757e-04
Validation auc = 0.696609
Epoch 3824
Loss = 1.2389e-02, PNorm = 574.3689, GNorm = 0.2201, lr_0 = 9.9757e-04
Validation auc = 0.696507
Epoch 3825
Loss = 1.7982e-02, PNorm = 574.4048, GNorm = 1.6944, lr_0 = 9.9757e-04
Validation auc = 0.699968
Epoch 3826
Loss = 3.1417e-02, PNorm = 574.4347, GNorm = 1.0083, lr_0 = 9.9757e-04
Validation auc = 0.702554
Epoch 3827
Loss = 7.8246e-03, PNorm = 574.4749, GNorm = 0.0384, lr_0 = 9.9756e-04
Validation auc = 0.707963
Epoch 3828
Loss = 1.2178e-01, PNorm = 574.5166, GNorm = 2.5684, lr_0 = 9.9756e-04
Validation auc = 0.706887
Epoch 3829
Loss = 9.8878e-04, PNorm = 574.5717, GNorm = 0.0693, lr_0 = 9.9756e-04
Loss = 6.3815e-02, PNorm = 574.6169, GNorm = 7.8206, lr_0 = 9.9756e-04
Validation auc = 0.705601
Epoch 3830
Loss = 1.6932e-02, PNorm = 574.6592, GNorm = 2.1428, lr_0 = 9.9756e-04
Validation auc = 0.702573
Epoch 3831
Loss = 4.4618e-02, PNorm = 574.6939, GNorm = 1.6736, lr_0 = 9.9756e-04
Validation auc = 0.702660
Epoch 3832
Loss = 5.0263e-02, PNorm = 574.7312, GNorm = 0.1233, lr_0 = 9.9756e-04
Validation auc = 0.707727
Epoch 3833
Loss = 2.5346e-02, PNorm = 574.7739, GNorm = 0.0777, lr_0 = 9.9756e-04
Validation auc = 0.708581
Epoch 3834
Loss = 4.0624e-02, PNorm = 574.8061, GNorm = 0.2467, lr_0 = 9.9756e-04
Validation auc = 0.708903
Epoch 3835
Loss = 2.4266e-02, PNorm = 574.8461, GNorm = 1.8030, lr_0 = 9.9756e-04
Validation auc = 0.705599
Epoch 3836
Loss = 6.0234e-02, PNorm = 574.8843, GNorm = 1.9190, lr_0 = 9.9756e-04
Validation auc = 0.712280
Epoch 3837
Loss = 5.4559e-03, PNorm = 574.9243, GNorm = 0.2708, lr_0 = 9.9756e-04
Validation auc = 0.707593
Epoch 3838
Loss = 7.1065e-04, PNorm = 574.9582, GNorm = 0.0489, lr_0 = 9.9756e-04
Validation auc = 0.702967
Epoch 3839
Loss = 1.9667e-02, PNorm = 574.9863, GNorm = 1.4067, lr_0 = 9.9756e-04
Loss = 4.6919e-02, PNorm = 575.0239, GNorm = 0.9653, lr_0 = 9.9756e-04
Validation auc = 0.696110
Epoch 3840
Loss = 2.4270e-02, PNorm = 575.0667, GNorm = 1.1283, lr_0 = 9.9755e-04
Validation auc = 0.691811
Epoch 3841
Loss = 1.4371e-01, PNorm = 575.1171, GNorm = 4.7827, lr_0 = 9.9755e-04
Validation auc = 0.700881
Epoch 3842
Loss = 7.8986e-02, PNorm = 575.1910, GNorm = 0.9630, lr_0 = 9.9755e-04
Validation auc = 0.706632
Epoch 3843
Loss = 4.8019e-02, PNorm = 575.2649, GNorm = 0.6817, lr_0 = 9.9755e-04
Validation auc = 0.710485
Epoch 3844
Loss = 1.3774e-01, PNorm = 575.3314, GNorm = 1.0132, lr_0 = 9.9755e-04
Validation auc = 0.715662
Epoch 3845
Loss = 6.8307e-02, PNorm = 575.4014, GNorm = 1.0899, lr_0 = 9.9755e-04
Validation auc = 0.715088
Epoch 3846
Loss = 5.3729e-02, PNorm = 575.4675, GNorm = 0.4620, lr_0 = 9.9755e-04
Validation auc = 0.712447
Epoch 3847
Loss = 4.0928e-02, PNorm = 575.5155, GNorm = 0.2326, lr_0 = 9.9755e-04
Validation auc = 0.712136
Epoch 3848
Loss = 4.9182e-02, PNorm = 575.5617, GNorm = 0.3373, lr_0 = 9.9755e-04
Validation auc = 0.715865
Epoch 3849
Loss = 5.4126e-03, PNorm = 575.6106, GNorm = 0.2378, lr_0 = 9.9755e-04
Loss = 4.1143e-02, PNorm = 575.6479, GNorm = 2.4910, lr_0 = 9.9755e-04
Validation auc = 0.721441
Epoch 3850
Loss = 3.4580e-02, PNorm = 575.6912, GNorm = 0.3498, lr_0 = 9.9755e-04
Validation auc = 0.704712
Epoch 3851
Loss = 7.5171e-02, PNorm = 575.7466, GNorm = 0.5610, lr_0 = 9.9755e-04
Validation auc = 0.693234
Epoch 3852
Loss = 3.1753e-02, PNorm = 575.8128, GNorm = 1.9264, lr_0 = 9.9755e-04
Validation auc = 0.693640
Epoch 3853
Loss = 7.3384e-02, PNorm = 575.8749, GNorm = 0.6364, lr_0 = 9.9754e-04
Validation auc = 0.686859
Epoch 3854
Loss = 9.3478e-02, PNorm = 575.9396, GNorm = 1.4996, lr_0 = 9.9754e-04
Validation auc = 0.684003
Epoch 3855
Loss = 5.0211e-02, PNorm = 576.0031, GNorm = 0.3008, lr_0 = 9.9754e-04
Validation auc = 0.687916
Epoch 3856
Loss = 4.8774e-02, PNorm = 576.0643, GNorm = 0.5187, lr_0 = 9.9754e-04
Validation auc = 0.691953
Epoch 3857
Loss = 3.1925e-02, PNorm = 576.1217, GNorm = 0.9026, lr_0 = 9.9754e-04
Validation auc = 0.697947
Epoch 3858
Loss = 3.7363e-02, PNorm = 576.1754, GNorm = 1.4087, lr_0 = 9.9754e-04
Validation auc = 0.702204
Epoch 3859
Loss = 8.4330e-03, PNorm = 576.2328, GNorm = 0.3178, lr_0 = 9.9754e-04
Loss = 5.5661e-02, PNorm = 576.2965, GNorm = 1.2446, lr_0 = 9.9754e-04
Validation auc = 0.705222
Epoch 3860
Loss = 1.5612e-01, PNorm = 576.3645, GNorm = 0.5348, lr_0 = 9.9754e-04
Validation auc = 0.713725
Epoch 3861
Loss = 7.4949e-02, PNorm = 576.4506, GNorm = 4.4714, lr_0 = 9.9754e-04
Validation auc = 0.714566
Epoch 3862
Loss = 4.2063e-02, PNorm = 576.5330, GNorm = 1.8600, lr_0 = 9.9754e-04
Validation auc = 0.720526
Epoch 3863
Loss = 1.1778e-01, PNorm = 576.6205, GNorm = 6.6733, lr_0 = 9.9754e-04
Validation auc = 0.726945
Epoch 3864
Loss = 5.0437e-02, PNorm = 576.7389, GNorm = 0.7934, lr_0 = 9.9754e-04
Validation auc = 0.720232
Epoch 3865
Loss = 7.0516e-02, PNorm = 576.8369, GNorm = 4.3164, lr_0 = 9.9754e-04
Validation auc = 0.720760
Epoch 3866
Loss = 3.6906e-02, PNorm = 576.9084, GNorm = 0.4797, lr_0 = 9.9754e-04
Validation auc = 0.718688
Epoch 3867
Loss = 3.0930e-02, PNorm = 576.9701, GNorm = 0.9234, lr_0 = 9.9753e-04
Validation auc = 0.714070
Epoch 3868
Loss = 2.4719e-02, PNorm = 577.0307, GNorm = 0.9740, lr_0 = 9.9753e-04
Validation auc = 0.702685
Epoch 3869
Loss = 6.6785e-03, PNorm = 577.1010, GNorm = 0.4090, lr_0 = 9.9753e-04
Loss = 7.4541e-02, PNorm = 577.1586, GNorm = 3.9869, lr_0 = 9.9753e-04
Validation auc = 0.700912
Epoch 3870
Loss = 5.9288e-02, PNorm = 577.2220, GNorm = 2.6479, lr_0 = 9.9753e-04
Validation auc = 0.703459
Epoch 3871
Loss = 4.4671e-02, PNorm = 577.2855, GNorm = 1.5693, lr_0 = 9.9753e-04
Validation auc = 0.714960
Epoch 3872
Loss = 4.6887e-02, PNorm = 577.3386, GNorm = 2.7049, lr_0 = 9.9753e-04
Validation auc = 0.722418
Epoch 3873
Loss = 7.4951e-02, PNorm = 577.3851, GNorm = 0.2083, lr_0 = 9.9753e-04
Validation auc = 0.730004
Epoch 3874
Loss = 4.7168e-02, PNorm = 577.4441, GNorm = 0.1817, lr_0 = 9.9753e-04
Validation auc = 0.730546
Epoch 3875
Loss = 2.5533e-02, PNorm = 577.5076, GNorm = 0.6436, lr_0 = 9.9753e-04
Validation auc = 0.729076
Epoch 3876
Loss = 1.8666e-02, PNorm = 577.5709, GNorm = 1.1621, lr_0 = 9.9753e-04
Validation auc = 0.730149
Epoch 3877
Loss = 7.5534e-03, PNorm = 577.6279, GNorm = 0.3236, lr_0 = 9.9753e-04
Validation auc = 0.727153
Epoch 3878
Loss = 2.7374e-02, PNorm = 577.6754, GNorm = 1.5060, lr_0 = 9.9753e-04
Validation auc = 0.726279
Epoch 3879
Loss = 2.0310e-03, PNorm = 577.7115, GNorm = 0.1413, lr_0 = 9.9753e-04
Loss = 4.5557e-02, PNorm = 577.7423, GNorm = 4.5789, lr_0 = 9.9753e-04
Validation auc = 0.723984
Epoch 3880
Loss = 1.1811e-01, PNorm = 577.7877, GNorm = 4.5109, lr_0 = 9.9752e-04
Validation auc = 0.712942
Epoch 3881
Loss = 6.3847e-02, PNorm = 577.8394, GNorm = 3.4753, lr_0 = 9.9752e-04
Validation auc = 0.703600
Epoch 3882
Loss = 1.5228e-01, PNorm = 577.9320, GNorm = 2.1794, lr_0 = 9.9752e-04
Validation auc = 0.707061
Epoch 3883
Loss = 3.6773e-02, PNorm = 578.0509, GNorm = 0.3358, lr_0 = 9.9752e-04
Validation auc = 0.723000
Epoch 3884
Loss = 9.9679e-02, PNorm = 578.1539, GNorm = 1.1681, lr_0 = 9.9752e-04
Validation auc = 0.734777
Epoch 3885
Loss = 1.2124e-01, PNorm = 578.2881, GNorm = 0.3098, lr_0 = 9.9752e-04
Validation auc = 0.725871
Epoch 3886
Loss = 8.7381e-02, PNorm = 578.4418, GNorm = 3.6821, lr_0 = 9.9752e-04
Validation auc = 0.725987
Epoch 3887
Loss = 1.1461e-01, PNorm = 578.5773, GNorm = 3.5113, lr_0 = 9.9752e-04
Validation auc = 0.720250
Epoch 3888
Loss = 3.7968e-02, PNorm = 578.7044, GNorm = 0.5509, lr_0 = 9.9752e-04
Validation auc = 0.721784
Epoch 3889
Loss = 3.1318e-02, PNorm = 578.8145, GNorm = 1.5454, lr_0 = 9.9752e-04
Loss = 4.6036e-02, PNorm = 578.9073, GNorm = 0.6638, lr_0 = 9.9752e-04
Validation auc = 0.727400
Epoch 3890
Loss = 9.2859e-02, PNorm = 578.9877, GNorm = 12.0659, lr_0 = 9.9752e-04
Validation auc = 0.738991
Epoch 3891
Loss = 4.6071e-02, PNorm = 579.0719, GNorm = 8.9916, lr_0 = 9.9752e-04
Validation auc = 0.731635
Epoch 3892
Loss = 2.7619e-02, PNorm = 579.1421, GNorm = 0.3846, lr_0 = 9.9752e-04
Validation auc = 0.725704
Epoch 3893
Loss = 1.1392e-01, PNorm = 579.2126, GNorm = 9.8293, lr_0 = 9.9751e-04
Validation auc = 0.714807
Epoch 3894
Loss = 5.1234e-02, PNorm = 579.3006, GNorm = 4.0941, lr_0 = 9.9751e-04
Validation auc = 0.709846
Epoch 3895
Loss = 4.7002e-02, PNorm = 579.3719, GNorm = 0.6424, lr_0 = 9.9751e-04
Validation auc = 0.702242
Epoch 3896
Loss = 8.0990e-02, PNorm = 579.4340, GNorm = 3.5389, lr_0 = 9.9751e-04
Validation auc = 0.705950
Epoch 3897
Loss = 1.1062e-01, PNorm = 579.5022, GNorm = 4.5662, lr_0 = 9.9751e-04
Validation auc = 0.707173
Epoch 3898
Loss = 1.0728e-01, PNorm = 579.5842, GNorm = 4.4607, lr_0 = 9.9751e-04
Validation auc = 0.710913
Epoch 3899
Loss = 7.8608e-02, PNorm = 579.7049, GNorm = 1.9475, lr_0 = 9.9751e-04
Loss = 6.6403e-02, PNorm = 579.8208, GNorm = 0.7167, lr_0 = 9.9751e-04
Validation auc = 0.726054
Epoch 3900
Loss = 1.0469e-01, PNorm = 579.9451, GNorm = 2.3675, lr_0 = 9.9751e-04
Validation auc = 0.706417
Epoch 3901
Loss = 6.1626e-02, PNorm = 580.0841, GNorm = 0.7386, lr_0 = 9.9751e-04
Validation auc = 0.685154
Epoch 3902
Loss = 1.1581e-01, PNorm = 580.1961, GNorm = 5.7996, lr_0 = 9.9751e-04
Validation auc = 0.694898
Epoch 3903
Loss = 7.1103e-02, PNorm = 580.3060, GNorm = 0.4628, lr_0 = 9.9751e-04
Validation auc = 0.687919
Epoch 3904
Loss = 6.4017e-02, PNorm = 580.3964, GNorm = 1.7770, lr_0 = 9.9751e-04
Validation auc = 0.691030
Epoch 3905
Loss = 8.1393e-02, PNorm = 580.4708, GNorm = 2.0832, lr_0 = 9.9751e-04
Validation auc = 0.692992
Epoch 3906
Loss = 3.1317e-02, PNorm = 580.5378, GNorm = 0.6521, lr_0 = 9.9751e-04
Validation auc = 0.696489
Epoch 3907
Loss = 1.6097e-01, PNorm = 580.6170, GNorm = 0.8811, lr_0 = 9.9750e-04
Validation auc = 0.700883
Epoch 3908
Loss = 6.0577e-02, PNorm = 580.7276, GNorm = 2.9590, lr_0 = 9.9750e-04
Validation auc = 0.703016
Epoch 3909
Loss = 9.1230e-02, PNorm = 580.8201, GNorm = 2.5205, lr_0 = 9.9750e-04
Loss = 8.4047e-02, PNorm = 580.9105, GNorm = 3.0850, lr_0 = 9.9750e-04
Validation auc = 0.701693
Epoch 3910
Loss = 7.6088e-02, PNorm = 581.0048, GNorm = 2.0872, lr_0 = 9.9750e-04
Validation auc = 0.707982
Epoch 3911
Loss = 7.3754e-02, PNorm = 581.1074, GNorm = 2.7780, lr_0 = 9.9750e-04
Validation auc = 0.692484
Epoch 3912
Loss = 9.2508e-02, PNorm = 581.2016, GNorm = 1.2882, lr_0 = 9.9750e-04
Validation auc = 0.700681
Epoch 3913
Loss = 6.0008e-02, PNorm = 581.2934, GNorm = 2.7671, lr_0 = 9.9750e-04
Validation auc = 0.701516
Epoch 3914
Loss = 9.6062e-02, PNorm = 581.3979, GNorm = 2.7860, lr_0 = 9.9750e-04
Validation auc = 0.703426
Epoch 3915
Loss = 4.9823e-02, PNorm = 581.5031, GNorm = 1.5192, lr_0 = 9.9750e-04
Validation auc = 0.706159
Epoch 3916
Loss = 4.9094e-02, PNorm = 581.5795, GNorm = 0.9502, lr_0 = 9.9750e-04
Validation auc = 0.713023
Epoch 3917
Loss = 6.1377e-02, PNorm = 581.6404, GNorm = 2.7169, lr_0 = 9.9750e-04
Validation auc = 0.719660
Epoch 3918
Loss = 2.1267e-02, PNorm = 581.6881, GNorm = 1.5272, lr_0 = 9.9750e-04
Validation auc = 0.723155
Epoch 3919
Loss = 5.8783e-03, PNorm = 581.7257, GNorm = 0.3667, lr_0 = 9.9750e-04
Loss = 1.1592e-01, PNorm = 581.7813, GNorm = 0.5080, lr_0 = 9.9749e-04
Validation auc = 0.697397
Epoch 3920
Loss = 5.8954e-02, PNorm = 581.8476, GNorm = 2.1635, lr_0 = 9.9749e-04
Validation auc = 0.687053
Epoch 3921
Loss = 1.0472e-01, PNorm = 581.9243, GNorm = 3.3982, lr_0 = 9.9749e-04
Validation auc = 0.684583
Epoch 3922
Loss = 1.3241e-01, PNorm = 582.0226, GNorm = 2.0143, lr_0 = 9.9749e-04
Validation auc = 0.698995
Epoch 3923
Loss = 9.0260e-02, PNorm = 582.1191, GNorm = 3.4760, lr_0 = 9.9749e-04
Validation auc = 0.710965
Epoch 3924
Loss = 7.0037e-02, PNorm = 582.2244, GNorm = 0.6554, lr_0 = 9.9749e-04
Validation auc = 0.702537
Epoch 3925
Loss = 2.8490e-01, PNorm = 582.3205, GNorm = 2.1272, lr_0 = 9.9749e-04
Validation auc = 0.701058
Epoch 3926
Loss = 8.9951e-02, PNorm = 582.4121, GNorm = 3.2765, lr_0 = 9.9749e-04
Validation auc = 0.699685
Epoch 3927
Loss = 1.5521e-02, PNorm = 582.4951, GNorm = 1.2380, lr_0 = 9.9749e-04
Validation auc = 0.700359
Epoch 3928
Loss = 1.3359e-01, PNorm = 582.5555, GNorm = 0.8301, lr_0 = 9.9749e-04
Validation auc = 0.701804
Epoch 3929
Loss = 1.3718e-01, PNorm = 582.6062, GNorm = 13.6996, lr_0 = 9.9749e-04
Loss = 4.9238e-02, PNorm = 582.6820, GNorm = 1.5586, lr_0 = 9.9749e-04
Validation auc = 0.720432
Epoch 3930
Loss = 1.0379e-01, PNorm = 582.7518, GNorm = 1.1842, lr_0 = 9.9749e-04
Validation auc = 0.725885
Epoch 3931
Loss = 2.1710e-02, PNorm = 582.8158, GNorm = 1.4448, lr_0 = 9.9749e-04
Validation auc = 0.719967
Epoch 3932
Loss = 3.6000e-02, PNorm = 582.8816, GNorm = 1.3396, lr_0 = 9.9749e-04
Validation auc = 0.704845
Epoch 3933
Loss = 1.5287e-01, PNorm = 582.9500, GNorm = 0.3324, lr_0 = 9.9748e-04
Validation auc = 0.700726
Epoch 3934
Loss = 6.7274e-02, PNorm = 583.0251, GNorm = 5.4325, lr_0 = 9.9748e-04
Validation auc = 0.703513
Epoch 3935
Loss = 6.6156e-02, PNorm = 583.0916, GNorm = 8.6572, lr_0 = 9.9748e-04
Validation auc = 0.704072
Epoch 3936
Loss = 6.0952e-02, PNorm = 583.1536, GNorm = 1.6851, lr_0 = 9.9748e-04
Validation auc = 0.703317
Epoch 3937
Loss = 9.5450e-02, PNorm = 583.2086, GNorm = 1.2319, lr_0 = 9.9748e-04
Validation auc = 0.704219
Epoch 3938
Loss = 2.3142e-02, PNorm = 583.2744, GNorm = 0.2158, lr_0 = 9.9748e-04
Validation auc = 0.703989
Epoch 3939
Loss = 9.6236e-02, PNorm = 583.3346, GNorm = 20.6208, lr_0 = 9.9748e-04
Loss = 3.7206e-02, PNorm = 583.4219, GNorm = 2.4357, lr_0 = 9.9748e-04
Validation auc = 0.692745
Epoch 3940
Loss = 2.7666e-02, PNorm = 583.4934, GNorm = 4.2881, lr_0 = 9.9748e-04
Validation auc = 0.692288
Epoch 3941
Loss = 1.2063e-01, PNorm = 583.5561, GNorm = 0.5198, lr_0 = 9.9748e-04
Validation auc = 0.700406
Epoch 3942
Loss = 6.9660e-02, PNorm = 583.6301, GNorm = 0.2712, lr_0 = 9.9748e-04
Validation auc = 0.703853
Epoch 3943
Loss = 2.0884e-02, PNorm = 583.6943, GNorm = 1.6227, lr_0 = 9.9748e-04
Validation auc = 0.703012
Epoch 3944
Loss = 3.6932e-02, PNorm = 583.7388, GNorm = 1.2638, lr_0 = 9.9748e-04
Validation auc = 0.703530
Epoch 3945
Loss = 1.0751e-01, PNorm = 583.7906, GNorm = 1.0391, lr_0 = 9.9748e-04
Validation auc = 0.714647
Epoch 3946
Loss = 6.2645e-02, PNorm = 583.8622, GNorm = 2.5953, lr_0 = 9.9747e-04
Validation auc = 0.717465
Epoch 3947
Loss = 7.0086e-02, PNorm = 583.9140, GNorm = 4.3196, lr_0 = 9.9747e-04
Validation auc = 0.717918
Epoch 3948
Loss = 3.3291e-02, PNorm = 583.9700, GNorm = 2.3488, lr_0 = 9.9747e-04
Validation auc = 0.719461
Epoch 3949
Loss = 5.0204e-02, PNorm = 584.0531, GNorm = 1.6518, lr_0 = 9.9747e-04
Loss = 5.4355e-02, PNorm = 584.1233, GNorm = 3.6281, lr_0 = 9.9747e-04
Validation auc = 0.719234
Epoch 3950
Loss = 6.3933e-02, PNorm = 584.1779, GNorm = 2.7783, lr_0 = 9.9747e-04
Validation auc = 0.715294
Epoch 3951
Loss = 3.8613e-02, PNorm = 584.2363, GNorm = 0.3938, lr_0 = 9.9747e-04
Validation auc = 0.708453
Epoch 3952
Loss = 6.6158e-02, PNorm = 584.2868, GNorm = 1.0177, lr_0 = 9.9747e-04
Validation auc = 0.705594
Epoch 3953
Loss = 9.5699e-02, PNorm = 584.3404, GNorm = 2.9417, lr_0 = 9.9747e-04
Validation auc = 0.703849
Epoch 3954
Loss = 2.9747e-02, PNorm = 584.4013, GNorm = 1.2534, lr_0 = 9.9747e-04
Validation auc = 0.706309
Epoch 3955
Loss = 6.3936e-02, PNorm = 584.4657, GNorm = 3.0785, lr_0 = 9.9747e-04
Validation auc = 0.706057
Epoch 3956
Loss = 4.7274e-02, PNorm = 584.5293, GNorm = 0.1725, lr_0 = 9.9747e-04
Validation auc = 0.710266
Epoch 3957
Loss = 4.9903e-02, PNorm = 584.5800, GNorm = 2.2411, lr_0 = 9.9747e-04
Validation auc = 0.710806
Epoch 3958
Loss = 2.0407e-01, PNorm = 584.6327, GNorm = 11.5942, lr_0 = 9.9747e-04
Validation auc = 0.692119
Epoch 3959
Loss = 3.3078e-02, PNorm = 584.7900, GNorm = 1.1677, lr_0 = 9.9747e-04
Loss = 3.7528e-02, PNorm = 584.9310, GNorm = 0.6921, lr_0 = 9.9746e-04
Validation auc = 0.700904
Epoch 3960
Loss = 6.0659e-02, PNorm = 585.0247, GNorm = 1.5057, lr_0 = 9.9746e-04
Validation auc = 0.710362
Epoch 3961
Loss = 1.0449e-01, PNorm = 585.1050, GNorm = 0.2494, lr_0 = 9.9746e-04
Validation auc = 0.703243
Epoch 3962
Loss = 9.5026e-02, PNorm = 585.1772, GNorm = 2.7969, lr_0 = 9.9746e-04
Validation auc = 0.702487
Epoch 3963
Loss = 5.4626e-02, PNorm = 585.2543, GNorm = 1.2829, lr_0 = 9.9746e-04
Validation auc = 0.698622
Epoch 3964
Loss = 7.2426e-02, PNorm = 585.3140, GNorm = 3.5442, lr_0 = 9.9746e-04
Validation auc = 0.688695
Epoch 3965
Loss = 6.0433e-02, PNorm = 585.3739, GNorm = 2.0488, lr_0 = 9.9746e-04
Validation auc = 0.691521
Epoch 3966
Loss = 4.0735e-02, PNorm = 585.4462, GNorm = 2.2595, lr_0 = 9.9746e-04
Validation auc = 0.683324
Epoch 3967
Loss = 8.7116e-02, PNorm = 585.5120, GNorm = 6.0501, lr_0 = 9.9746e-04
Validation auc = 0.683660
Epoch 3968
Loss = 9.2474e-02, PNorm = 585.5806, GNorm = 3.8373, lr_0 = 9.9746e-04
Validation auc = 0.687246
Epoch 3969
Loss = 2.1176e-02, PNorm = 585.6491, GNorm = 0.8778, lr_0 = 9.9746e-04
Loss = 5.7442e-02, PNorm = 585.7152, GNorm = 0.7849, lr_0 = 9.9746e-04
Validation auc = 0.696524
Epoch 3970
Loss = 9.0990e-02, PNorm = 585.7764, GNorm = 2.3938, lr_0 = 9.9746e-04
Validation auc = 0.698863
Epoch 3971
Loss = 4.3192e-02, PNorm = 585.8350, GNorm = 0.6742, lr_0 = 9.9746e-04
Validation auc = 0.701729
Epoch 3972
Loss = 4.6944e-02, PNorm = 585.9095, GNorm = 1.8159, lr_0 = 9.9746e-04
Validation auc = 0.701559
Epoch 3973
Loss = 5.3945e-02, PNorm = 585.9730, GNorm = 4.6732, lr_0 = 9.9745e-04
Validation auc = 0.694773
Epoch 3974
Loss = 2.3663e-02, PNorm = 586.0316, GNorm = 0.3071, lr_0 = 9.9745e-04
Validation auc = 0.698281
Epoch 3975
Loss = 5.7707e-02, PNorm = 586.0852, GNorm = 1.3377, lr_0 = 9.9745e-04
Validation auc = 0.700492
Epoch 3976
Loss = 4.2744e-02, PNorm = 586.1280, GNorm = 1.0445, lr_0 = 9.9745e-04
Validation auc = 0.700319
Epoch 3977
Loss = 1.6543e-02, PNorm = 586.1793, GNorm = 1.5167, lr_0 = 9.9745e-04
Validation auc = 0.704786
Epoch 3978
Loss = 5.5514e-02, PNorm = 586.2611, GNorm = 3.7252, lr_0 = 9.9745e-04
Validation auc = 0.706130
Epoch 3979
Loss = 7.7675e-02, PNorm = 586.3762, GNorm = 3.4057, lr_0 = 9.9745e-04
Loss = 6.9959e-02, PNorm = 586.5139, GNorm = 2.9839, lr_0 = 9.9745e-04
Validation auc = 0.716085
Epoch 3980
Loss = 1.3292e-01, PNorm = 586.6422, GNorm = 2.6241, lr_0 = 9.9745e-04
Validation auc = 0.678034
Epoch 3981
Loss = 5.0310e-02, PNorm = 586.7393, GNorm = 0.3929, lr_0 = 9.9745e-04
Validation auc = 0.673482
Epoch 3982
Loss = 2.7465e-02, PNorm = 586.8052, GNorm = 5.1358, lr_0 = 9.9745e-04
Validation auc = 0.681051
Epoch 3983
Loss = 3.9928e-02, PNorm = 586.8597, GNorm = 0.6802, lr_0 = 9.9745e-04
Validation auc = 0.680678
Epoch 3984
Loss = 5.8376e-02, PNorm = 586.9073, GNorm = 0.5030, lr_0 = 9.9745e-04
Validation auc = 0.686708
Epoch 3985
Loss = 5.8754e-02, PNorm = 586.9464, GNorm = 1.0957, lr_0 = 9.9745e-04
Validation auc = 0.684685
Epoch 3986
Loss = 4.9090e-02, PNorm = 586.9816, GNorm = 0.5452, lr_0 = 9.9744e-04
Validation auc = 0.684324
Epoch 3987
Loss = 2.5285e-02, PNorm = 587.0152, GNorm = 2.0210, lr_0 = 9.9744e-04
Validation auc = 0.683159
Epoch 3988
Loss = 4.5437e-02, PNorm = 587.0498, GNorm = 2.2286, lr_0 = 9.9744e-04
Validation auc = 0.680062
Epoch 3989
Loss = 5.3650e-01, PNorm = 587.0867, GNorm = 13.2967, lr_0 = 9.9744e-04
Loss = 5.2096e-02, PNorm = 587.1389, GNorm = 5.9388, lr_0 = 9.9744e-04
Validation auc = 0.686806
Epoch 3990
Loss = 5.9298e-02, PNorm = 587.2034, GNorm = 3.1102, lr_0 = 9.9744e-04
Validation auc = 0.689111
Epoch 3991
Loss = 9.1710e-02, PNorm = 587.2710, GNorm = 0.2494, lr_0 = 9.9744e-04
Validation auc = 0.688265
Epoch 3992
Loss = 5.1388e-02, PNorm = 587.3417, GNorm = 3.8212, lr_0 = 9.9744e-04
Validation auc = 0.694350
Epoch 3993
Loss = 5.1534e-02, PNorm = 587.4173, GNorm = 0.2905, lr_0 = 9.9744e-04
Validation auc = 0.693002
Epoch 3994
Loss = 6.7116e-02, PNorm = 587.4752, GNorm = 2.9645, lr_0 = 9.9744e-04
Validation auc = 0.696390
Epoch 3995
Loss = 1.2367e-01, PNorm = 587.5243, GNorm = 6.6650, lr_0 = 9.9744e-04
Validation auc = 0.699147
Epoch 3996
Loss = 2.8647e-02, PNorm = 587.6007, GNorm = 0.5695, lr_0 = 9.9744e-04
Validation auc = 0.702489
Epoch 3997
Loss = 2.9670e-02, PNorm = 587.6696, GNorm = 0.4874, lr_0 = 9.9744e-04
Validation auc = 0.702741
Epoch 3998
Loss = 4.7404e-02, PNorm = 587.7197, GNorm = 0.9178, lr_0 = 9.9744e-04
Validation auc = 0.702849
Epoch 3999
Loss = 1.4590e-02, PNorm = 587.7614, GNorm = 0.7562, lr_0 = 9.9744e-04
Loss = 3.3102e-02, PNorm = 587.7972, GNorm = 0.6843, lr_0 = 9.9743e-04
Validation auc = 0.707241
Epoch 4000
Loss = 5.6799e-02, PNorm = 587.8329, GNorm = 4.1762, lr_0 = 9.9743e-04
Validation auc = 0.705223
Epoch 4001
Loss = 8.1091e-02, PNorm = 587.8792, GNorm = 6.9117, lr_0 = 9.9743e-04
Validation auc = 0.707663
Epoch 4002
Loss = 2.1963e-02, PNorm = 587.9465, GNorm = 0.7828, lr_0 = 9.9743e-04
Validation auc = 0.718649
Epoch 4003
Loss = 4.5748e-02, PNorm = 588.0090, GNorm = 0.9597, lr_0 = 9.9743e-04
Validation auc = 0.722843
Epoch 4004
Loss = 5.2063e-02, PNorm = 588.0671, GNorm = 1.8286, lr_0 = 9.9743e-04
Validation auc = 0.716929
Epoch 4005
Loss = 4.3480e-02, PNorm = 588.1148, GNorm = 0.1308, lr_0 = 9.9743e-04
Validation auc = 0.715567
Epoch 4006
Loss = 3.2122e-02, PNorm = 588.1611, GNorm = 2.2739, lr_0 = 9.9743e-04
Validation auc = 0.712397
Epoch 4007
Loss = 1.4734e-01, PNorm = 588.2109, GNorm = 0.7092, lr_0 = 9.9743e-04
Validation auc = 0.712639
Epoch 4008
Loss = 4.5318e-02, PNorm = 588.2696, GNorm = 0.9136, lr_0 = 9.9743e-04
Validation auc = 0.707963
Epoch 4009
Loss = 2.1228e-02, PNorm = 588.3343, GNorm = 0.8738, lr_0 = 9.9743e-04
Loss = 4.6001e-02, PNorm = 588.3927, GNorm = 1.0683, lr_0 = 9.9743e-04
Validation auc = 0.707586
Epoch 4010
Loss = 1.2213e-01, PNorm = 588.4498, GNorm = 3.5969, lr_0 = 9.9743e-04
Validation auc = 0.702316
Epoch 4011
Loss = 6.0739e-02, PNorm = 588.5137, GNorm = 0.8202, lr_0 = 9.9743e-04
Validation auc = 0.689840
Epoch 4012
Loss = 5.0200e-02, PNorm = 588.5859, GNorm = 1.4370, lr_0 = 9.9742e-04
Validation auc = 0.679256
Epoch 4013
Loss = 5.4249e-02, PNorm = 588.6540, GNorm = 0.5606, lr_0 = 9.9742e-04
Validation auc = 0.672913
Epoch 4014
Loss = 3.6704e-02, PNorm = 588.7162, GNorm = 2.8617, lr_0 = 9.9742e-04
Validation auc = 0.676146
Epoch 4015
Loss = 2.2895e-02, PNorm = 588.7672, GNorm = 0.5797, lr_0 = 9.9742e-04
Validation auc = 0.681897
Epoch 4016
Loss = 5.0808e-02, PNorm = 588.8166, GNorm = 3.0708, lr_0 = 9.9742e-04
Validation auc = 0.680560
Epoch 4017
Loss = 6.4597e-02, PNorm = 588.8688, GNorm = 2.5854, lr_0 = 9.9742e-04
Validation auc = 0.682411
Epoch 4018
Loss = 4.3238e-03, PNorm = 588.9229, GNorm = 0.2662, lr_0 = 9.9742e-04
Validation auc = 0.688236
Epoch 4019
Loss = 1.7356e-02, PNorm = 588.9692, GNorm = 0.8228, lr_0 = 9.9742e-04
Loss = 2.6101e-02, PNorm = 589.0082, GNorm = 2.5085, lr_0 = 9.9742e-04
Validation auc = 0.693855
Epoch 4020
Loss = 4.5732e-02, PNorm = 589.0439, GNorm = 0.1979, lr_0 = 9.9742e-04
Validation auc = 0.693873
Epoch 4021
Loss = 4.8730e-02, PNorm = 589.0909, GNorm = 2.8278, lr_0 = 9.9742e-04
Validation auc = 0.687469
Epoch 4022
Loss = 6.9838e-02, PNorm = 589.1419, GNorm = 4.0571, lr_0 = 9.9742e-04
Validation auc = 0.675527
Epoch 4023
Loss = 3.0232e-02, PNorm = 589.1994, GNorm = 0.7807, lr_0 = 9.9742e-04
Validation auc = 0.672080
Epoch 4024
Loss = 1.6640e-02, PNorm = 589.2571, GNorm = 2.0205, lr_0 = 9.9742e-04
Validation auc = 0.677311
Epoch 4025
Loss = 5.3453e-02, PNorm = 589.3107, GNorm = 4.1668, lr_0 = 9.9742e-04
Validation auc = 0.674113
Epoch 4026
Loss = 9.7979e-02, PNorm = 589.3704, GNorm = 4.3607, lr_0 = 9.9741e-04
Validation auc = 0.669384
Epoch 4027
Loss = 4.6864e-02, PNorm = 589.4348, GNorm = 3.4717, lr_0 = 9.9741e-04
Validation auc = 0.674189
Epoch 4028
Loss = 6.6124e-02, PNorm = 589.4864, GNorm = 1.2407, lr_0 = 9.9741e-04
Validation auc = 0.673741
Epoch 4029
Loss = 1.2159e-02, PNorm = 589.5304, GNorm = 0.4392, lr_0 = 9.9741e-04
Loss = 2.8475e-02, PNorm = 589.5669, GNorm = 0.1445, lr_0 = 9.9741e-04
Validation auc = 0.673620
Epoch 4030
Loss = 4.8870e-02, PNorm = 589.6176, GNorm = 0.2540, lr_0 = 9.9741e-04
Validation auc = 0.667910
Epoch 4031
Loss = 3.5424e-02, PNorm = 589.6708, GNorm = 3.1362, lr_0 = 9.9741e-04
Validation auc = 0.667261
Epoch 4032
Loss = 4.4486e-02, PNorm = 589.7154, GNorm = 0.3363, lr_0 = 9.9741e-04
Validation auc = 0.665689
Epoch 4033
Loss = 2.5324e-02, PNorm = 589.7606, GNorm = 1.9534, lr_0 = 9.9741e-04
Validation auc = 0.669792
Epoch 4034
Loss = 1.1736e-01, PNorm = 589.8071, GNorm = 2.8280, lr_0 = 9.9741e-04
Validation auc = 0.670138
Epoch 4035
Loss = 5.0256e-02, PNorm = 589.8541, GNorm = 1.9273, lr_0 = 9.9741e-04
Validation auc = 0.667861
Epoch 4036
Loss = 2.0508e-02, PNorm = 589.8991, GNorm = 0.3294, lr_0 = 9.9741e-04
Validation auc = 0.664654
Epoch 4037
Loss = 2.3644e-02, PNorm = 589.9330, GNorm = 4.1877, lr_0 = 9.9741e-04
Validation auc = 0.677288
Epoch 4038
Loss = 6.1734e-03, PNorm = 589.9735, GNorm = 0.3442, lr_0 = 9.9741e-04
Validation auc = 0.683909
Epoch 4039
Loss = 2.1303e-02, PNorm = 590.0045, GNorm = 3.4113, lr_0 = 9.9740e-04
Loss = 5.7599e-02, PNorm = 590.0380, GNorm = 4.5042, lr_0 = 9.9740e-04
Validation auc = 0.680497
Epoch 4040
Loss = 5.8878e-02, PNorm = 590.0816, GNorm = 0.0460, lr_0 = 9.9740e-04
Validation auc = 0.665970
Epoch 4041
Loss = 1.5415e-01, PNorm = 590.1422, GNorm = 1.4332, lr_0 = 9.9740e-04
Validation auc = 0.655076
Epoch 4042
Loss = 6.4373e-02, PNorm = 590.2035, GNorm = 1.9938, lr_0 = 9.9740e-04
Validation auc = 0.657873
Epoch 4043
Loss = 4.1614e-02, PNorm = 590.2512, GNorm = 0.4443, lr_0 = 9.9740e-04
Validation auc = 0.665811
Epoch 4044
Loss = 3.4633e-02, PNorm = 590.2870, GNorm = 1.1357, lr_0 = 9.9740e-04
Validation auc = 0.672242
Epoch 4045
Loss = 1.2352e-02, PNorm = 590.3172, GNorm = 0.2133, lr_0 = 9.9740e-04
Validation auc = 0.672026
Epoch 4046
Loss = 2.3495e-02, PNorm = 590.3443, GNorm = 1.6539, lr_0 = 9.9740e-04
Validation auc = 0.674208
Epoch 4047
Loss = 5.7495e-02, PNorm = 590.3696, GNorm = 3.1382, lr_0 = 9.9740e-04
Validation auc = 0.673092
Epoch 4048
Loss = 1.5103e-01, PNorm = 590.3939, GNorm = 2.0156, lr_0 = 9.9740e-04
Validation auc = 0.677189
Epoch 4049
Loss = 2.2867e-03, PNorm = 590.4247, GNorm = 0.1233, lr_0 = 9.9740e-04
Loss = 2.5057e-02, PNorm = 590.4563, GNorm = 0.1451, lr_0 = 9.9740e-04
Validation auc = 0.673191
Epoch 4050
Loss = 2.3118e-02, PNorm = 590.4833, GNorm = 2.7228, lr_0 = 9.9740e-04
Validation auc = 0.670926
Epoch 4051
Loss = 1.4444e-02, PNorm = 590.5059, GNorm = 0.6630, lr_0 = 9.9740e-04
Validation auc = 0.671122
Epoch 4052
Loss = 4.6645e-02, PNorm = 590.5378, GNorm = 0.0765, lr_0 = 9.9739e-04
Validation auc = 0.684397
Epoch 4053
Loss = 5.5557e-02, PNorm = 590.5776, GNorm = 0.1580, lr_0 = 9.9739e-04
Validation auc = 0.682140
Epoch 4054
Loss = 1.1244e-02, PNorm = 590.6101, GNorm = 0.5003, lr_0 = 9.9739e-04
Validation auc = 0.678919
Epoch 4055
Loss = 7.4633e-02, PNorm = 590.6383, GNorm = 2.1363, lr_0 = 9.9739e-04
Validation auc = 0.676735
Epoch 4056
Loss = 1.5283e-02, PNorm = 590.6707, GNorm = 0.3483, lr_0 = 9.9739e-04
Validation auc = 0.678207
Epoch 4057
Loss = 1.3688e-02, PNorm = 590.7023, GNorm = 1.2415, lr_0 = 9.9739e-04
Validation auc = 0.679332
Epoch 4058
Loss = 1.2327e-02, PNorm = 590.7351, GNorm = 0.2884, lr_0 = 9.9739e-04
Validation auc = 0.678581
Epoch 4059
Loss = 5.5123e-02, PNorm = 590.7831, GNorm = 2.7959, lr_0 = 9.9739e-04
Loss = 1.2224e-01, PNorm = 590.8565, GNorm = 6.0287, lr_0 = 9.9739e-04
Validation auc = 0.676207
Epoch 4060
Loss = 4.4250e-02, PNorm = 590.9370, GNorm = 4.0093, lr_0 = 9.9739e-04
Validation auc = 0.672161
Epoch 4061
Loss = 9.0023e-02, PNorm = 591.0069, GNorm = 3.6252, lr_0 = 9.9739e-04
Validation auc = 0.674139
Epoch 4062
Loss = 4.4721e-02, PNorm = 591.0777, GNorm = 3.3177, lr_0 = 9.9739e-04
Validation auc = 0.682472
Epoch 4063
Loss = 4.2009e-02, PNorm = 591.1357, GNorm = 2.9213, lr_0 = 9.9739e-04
Validation auc = 0.684376
Epoch 4064
Loss = 5.4417e-02, PNorm = 591.1889, GNorm = 3.0291, lr_0 = 9.9739e-04
Validation auc = 0.686070
Epoch 4065
Loss = 7.6835e-02, PNorm = 591.2384, GNorm = 2.5379, lr_0 = 9.9738e-04
Validation auc = 0.687552
Epoch 4066
Loss = 2.7947e-02, PNorm = 591.2865, GNorm = 1.5143, lr_0 = 9.9738e-04
Validation auc = 0.679561
Epoch 4067
Loss = 1.6241e-02, PNorm = 591.3351, GNorm = 2.1514, lr_0 = 9.9738e-04
Validation auc = 0.675264
Epoch 4068
Loss = 1.2787e-02, PNorm = 591.3849, GNorm = 1.5041, lr_0 = 9.9738e-04
Validation auc = 0.676006
Epoch 4069
Loss = 1.5791e-03, PNorm = 591.4293, GNorm = 0.1348, lr_0 = 9.9738e-04
Loss = 7.9734e-02, PNorm = 591.4760, GNorm = 8.3761, lr_0 = 9.9738e-04
Validation auc = 0.672108
Epoch 4070
Loss = 4.6667e-02, PNorm = 591.5439, GNorm = 0.3162, lr_0 = 9.9738e-04
Validation auc = 0.662935
Epoch 4071
Loss = 5.2683e-02, PNorm = 591.6196, GNorm = 1.5580, lr_0 = 9.9738e-04
Validation auc = 0.664499
Epoch 4072
Loss = 4.6924e-02, PNorm = 591.6849, GNorm = 1.0688, lr_0 = 9.9738e-04
Validation auc = 0.668099
Epoch 4073
Loss = 7.1518e-02, PNorm = 591.7470, GNorm = 1.0102, lr_0 = 9.9738e-04
Validation auc = 0.670983
Epoch 4074
Loss = 7.9062e-02, PNorm = 591.7932, GNorm = 3.0008, lr_0 = 9.9738e-04
Validation auc = 0.675713
Epoch 4075
Loss = 2.7376e-02, PNorm = 591.8355, GNorm = 0.5318, lr_0 = 9.9738e-04
Validation auc = 0.677155
Epoch 4076
Loss = 4.6362e-02, PNorm = 591.8804, GNorm = 0.7751, lr_0 = 9.9738e-04
Validation auc = 0.692034
Epoch 4077
Loss = 8.3003e-02, PNorm = 591.9332, GNorm = 2.4201, lr_0 = 9.9738e-04
Validation auc = 0.689282
Epoch 4078
Loss = 7.4457e-02, PNorm = 591.9908, GNorm = 0.4474, lr_0 = 9.9738e-04
Validation auc = 0.688773
Epoch 4079
Loss = 3.8830e-02, PNorm = 592.0483, GNorm = 2.6278, lr_0 = 9.9737e-04
Loss = 3.7532e-02, PNorm = 592.1022, GNorm = 0.4100, lr_0 = 9.9737e-04
Validation auc = 0.693715
Epoch 4080
Loss = 5.5169e-02, PNorm = 592.1593, GNorm = 0.5062, lr_0 = 9.9737e-04
Validation auc = 0.703564
Epoch 4081
Loss = 3.4923e-02, PNorm = 592.2162, GNorm = 2.5296, lr_0 = 9.9737e-04
Validation auc = 0.710474
Epoch 4082
Loss = 5.1884e-02, PNorm = 592.2692, GNorm = 4.6126, lr_0 = 9.9737e-04
Validation auc = 0.719866
Epoch 4083
Loss = 5.3913e-02, PNorm = 592.3293, GNorm = 0.7318, lr_0 = 9.9737e-04
Validation auc = 0.724311
Epoch 4084
Loss = 2.1590e-02, PNorm = 592.3994, GNorm = 0.2033, lr_0 = 9.9737e-04
Validation auc = 0.719729
Epoch 4085
Loss = 8.5717e-02, PNorm = 592.4501, GNorm = 0.2810, lr_0 = 9.9737e-04
Validation auc = 0.709194
Epoch 4086
Loss = 6.1632e-02, PNorm = 592.5153, GNorm = 1.5628, lr_0 = 9.9737e-04
Validation auc = 0.710905
Epoch 4087
Loss = 2.1531e-02, PNorm = 592.5771, GNorm = 1.7848, lr_0 = 9.9737e-04
Validation auc = 0.714459
Epoch 4088
Loss = 3.1697e-02, PNorm = 592.6233, GNorm = 0.6964, lr_0 = 9.9737e-04
Validation auc = 0.714955
Epoch 4089
Loss = 1.6275e-02, PNorm = 592.6623, GNorm = 2.6752, lr_0 = 9.9737e-04
Loss = 3.8923e-02, PNorm = 592.7067, GNorm = 1.5851, lr_0 = 9.9737e-04
Validation auc = 0.718150
Epoch 4090
Loss = 1.4794e-02, PNorm = 592.7519, GNorm = 0.2132, lr_0 = 9.9737e-04
Validation auc = 0.722751
Epoch 4091
Loss = 4.6033e-02, PNorm = 592.7878, GNorm = 6.4942, lr_0 = 9.9737e-04
Validation auc = 0.726025
Epoch 4092
Loss = 6.1878e-02, PNorm = 592.8385, GNorm = 0.2563, lr_0 = 9.9736e-04
Validation auc = 0.726936
Epoch 4093
Loss = 3.8203e-02, PNorm = 592.8953, GNorm = 1.4470, lr_0 = 9.9736e-04
Validation auc = 0.723847
Epoch 4094
Loss = 2.9487e-02, PNorm = 592.9697, GNorm = 2.8665, lr_0 = 9.9736e-04
Validation auc = 0.728188
Epoch 4095
Loss = 4.5920e-02, PNorm = 593.0391, GNorm = 1.0651, lr_0 = 9.9736e-04
Validation auc = 0.724207
Epoch 4096
Loss = 2.8490e-02, PNorm = 593.1045, GNorm = 0.4453, lr_0 = 9.9736e-04
Validation auc = 0.727798
Epoch 4097
Loss = 5.4569e-02, PNorm = 593.1738, GNorm = 0.5793, lr_0 = 9.9736e-04
Validation auc = 0.728163
Epoch 4098
Loss = 1.5793e-02, PNorm = 593.2282, GNorm = 0.5028, lr_0 = 9.9736e-04
Validation auc = 0.733308
Epoch 4099
Loss = 9.0221e-03, PNorm = 593.2721, GNorm = 0.5360, lr_0 = 9.9736e-04
Loss = 4.1006e-02, PNorm = 593.3182, GNorm = 4.5847, lr_0 = 9.9736e-04
Validation auc = 0.739126
Epoch 4100
Loss = 1.5545e-02, PNorm = 593.3690, GNorm = 2.1138, lr_0 = 9.9736e-04
Validation auc = 0.740921
Epoch 4101
Loss = 3.7476e-02, PNorm = 593.4095, GNorm = 0.2249, lr_0 = 9.9736e-04
Validation auc = 0.741153
Epoch 4102
Loss = 4.2325e-02, PNorm = 593.4576, GNorm = 3.2632, lr_0 = 9.9736e-04
Validation auc = 0.737496
Epoch 4103
Loss = 6.2318e-02, PNorm = 593.5189, GNorm = 0.5587, lr_0 = 9.9736e-04
Validation auc = 0.729644
Epoch 4104
Loss = 3.7620e-02, PNorm = 593.5932, GNorm = 0.1667, lr_0 = 9.9736e-04
Validation auc = 0.724110
Epoch 4105
Loss = 2.8181e-02, PNorm = 593.6557, GNorm = 0.3960, lr_0 = 9.9735e-04
Validation auc = 0.723449
Epoch 4106
Loss = 7.1054e-02, PNorm = 593.7036, GNorm = 0.9535, lr_0 = 9.9735e-04
Validation auc = 0.724987
Epoch 4107
Loss = 1.2380e-02, PNorm = 593.7419, GNorm = 0.2113, lr_0 = 9.9735e-04
Validation auc = 0.723270
Epoch 4108
Loss = 2.9252e-02, PNorm = 593.7731, GNorm = 0.3661, lr_0 = 9.9735e-04
Validation auc = 0.717108
Epoch 4109
Loss = 6.6276e-02, PNorm = 593.8063, GNorm = 7.8432, lr_0 = 9.9735e-04
Loss = 5.4359e-02, PNorm = 593.8434, GNorm = 3.1554, lr_0 = 9.9735e-04
Validation auc = 0.705439
Epoch 4110
Loss = 4.3661e-02, PNorm = 593.8878, GNorm = 0.7760, lr_0 = 9.9735e-04
Validation auc = 0.701576
Epoch 4111
Loss = 1.1110e-01, PNorm = 593.9345, GNorm = 1.5650, lr_0 = 9.9735e-04
Validation auc = 0.694990
Epoch 4112
Loss = 5.3100e-02, PNorm = 593.9856, GNorm = 0.5576, lr_0 = 9.9735e-04
Validation auc = 0.688333
Epoch 4113
Loss = 5.6808e-02, PNorm = 594.0326, GNorm = 0.2919, lr_0 = 9.9735e-04
Validation auc = 0.687927
Epoch 4114
Loss = 2.5121e-02, PNorm = 594.0797, GNorm = 0.7182, lr_0 = 9.9735e-04
Validation auc = 0.689058
Epoch 4115
Loss = 6.8546e-02, PNorm = 594.1307, GNorm = 2.1173, lr_0 = 9.9735e-04
Validation auc = 0.693425
Epoch 4116
Loss = 1.8167e-02, PNorm = 594.1914, GNorm = 0.2774, lr_0 = 9.9735e-04
Validation auc = 0.693717
Epoch 4117
Loss = 2.0792e-01, PNorm = 594.2382, GNorm = 0.3175, lr_0 = 9.9735e-04
Validation auc = 0.689230
Epoch 4118
Loss = 7.7735e-03, PNorm = 594.2909, GNorm = 1.6639, lr_0 = 9.9735e-04
Validation auc = 0.696439
Epoch 4119
Loss = 1.9059e-02, PNorm = 594.3423, GNorm = 1.3301, lr_0 = 9.9734e-04
Loss = 1.9648e-02, PNorm = 594.3856, GNorm = 1.0930, lr_0 = 9.9734e-04
Validation auc = 0.709701
Epoch 4120
Loss = 1.7276e-02, PNorm = 594.4174, GNorm = 0.1395, lr_0 = 9.9734e-04
Validation auc = 0.717242
Epoch 4121
Loss = 7.6517e-02, PNorm = 594.4392, GNorm = 0.1256, lr_0 = 9.9734e-04
Validation auc = 0.716768
Epoch 4122
Loss = 2.8736e-02, PNorm = 594.4690, GNorm = 0.8468, lr_0 = 9.9734e-04
Validation auc = 0.712726
Epoch 4123
Loss = 7.2373e-02, PNorm = 594.5228, GNorm = 1.1157, lr_0 = 9.9734e-04
Validation auc = 0.701413
Epoch 4124
Loss = 4.6182e-02, PNorm = 594.5870, GNorm = 0.5669, lr_0 = 9.9734e-04
Validation auc = 0.697368
Epoch 4125
Loss = 5.2014e-02, PNorm = 594.6464, GNorm = 4.0197, lr_0 = 9.9734e-04
Validation auc = 0.698248
Epoch 4126
Loss = 7.9614e-02, PNorm = 594.6974, GNorm = 1.0559, lr_0 = 9.9734e-04
Validation auc = 0.711348
Epoch 4127
Loss = 2.9869e-02, PNorm = 594.7452, GNorm = 2.4262, lr_0 = 9.9734e-04
Validation auc = 0.717728
Epoch 4128
Loss = 2.1223e-02, PNorm = 594.7821, GNorm = 0.3097, lr_0 = 9.9734e-04
Validation auc = 0.723093
Epoch 4129
Loss = 2.5488e-02, PNorm = 594.8260, GNorm = 2.2044, lr_0 = 9.9734e-04
Loss = 1.3850e-02, PNorm = 594.8710, GNorm = 0.0657, lr_0 = 9.9734e-04
Validation auc = 0.731077
Epoch 4130
Loss = 1.9634e-02, PNorm = 594.9068, GNorm = 0.1246, lr_0 = 9.9734e-04
Validation auc = 0.731769
Epoch 4131
Loss = 3.7584e-02, PNorm = 594.9420, GNorm = 0.3335, lr_0 = 9.9733e-04
Validation auc = 0.727942
Epoch 4132
Loss = 3.9626e-02, PNorm = 594.9792, GNorm = 0.1744, lr_0 = 9.9733e-04
Validation auc = 0.722486
Epoch 4133
Loss = 1.0877e-01, PNorm = 595.0285, GNorm = 0.6671, lr_0 = 9.9733e-04
Validation auc = 0.724390
Epoch 4134
Loss = 5.1546e-02, PNorm = 595.0862, GNorm = 1.4891, lr_0 = 9.9733e-04
Validation auc = 0.724108
Epoch 4135
Loss = 3.6812e-02, PNorm = 595.1365, GNorm = 3.6890, lr_0 = 9.9733e-04
Validation auc = 0.724746
Epoch 4136
Loss = 2.7465e-02, PNorm = 595.1864, GNorm = 1.4368, lr_0 = 9.9733e-04
Validation auc = 0.727659
Epoch 4137
Loss = 1.4099e-02, PNorm = 595.2276, GNorm = 0.2773, lr_0 = 9.9733e-04
Validation auc = 0.728859
Epoch 4138
Loss = 2.0447e-02, PNorm = 595.2645, GNorm = 1.4976, lr_0 = 9.9733e-04
Validation auc = 0.729068
Epoch 4139
Loss = 6.9935e-03, PNorm = 595.3135, GNorm = 0.3265, lr_0 = 9.9733e-04
Loss = 1.9695e-02, PNorm = 595.3683, GNorm = 0.6231, lr_0 = 9.9733e-04
Validation auc = 0.727920
Epoch 4140
Loss = 4.7355e-02, PNorm = 595.4060, GNorm = 2.3450, lr_0 = 9.9733e-04
Validation auc = 0.723458
Epoch 4141
Loss = 2.7208e-02, PNorm = 595.4447, GNorm = 1.7711, lr_0 = 9.9733e-04
Validation auc = 0.722465
Epoch 4142
Loss = 3.8111e-02, PNorm = 595.4878, GNorm = 1.7266, lr_0 = 9.9733e-04
Validation auc = 0.728364
Epoch 4143
Loss = 6.0792e-02, PNorm = 595.5368, GNorm = 6.0222, lr_0 = 9.9733e-04
Validation auc = 0.717318
Epoch 4144
Loss = 8.4787e-03, PNorm = 595.5825, GNorm = 0.4441, lr_0 = 9.9733e-04
Validation auc = 0.707041
Epoch 4145
Loss = 6.3041e-02, PNorm = 595.6239, GNorm = 0.1917, lr_0 = 9.9732e-04
Validation auc = 0.703180
Epoch 4146
Loss = 5.2191e-02, PNorm = 595.6909, GNorm = 6.3998, lr_0 = 9.9732e-04
Validation auc = 0.712546
Epoch 4147
Loss = 2.4452e-02, PNorm = 595.7747, GNorm = 0.0868, lr_0 = 9.9732e-04
Validation auc = 0.722534
Epoch 4148
Loss = 1.1228e-01, PNorm = 595.8572, GNorm = 0.5993, lr_0 = 9.9732e-04
Validation auc = 0.708177
Epoch 4149
Loss = 1.2333e-02, PNorm = 595.9339, GNorm = 0.4956, lr_0 = 9.9732e-04
Loss = 3.5693e-02, PNorm = 595.9865, GNorm = 0.4349, lr_0 = 9.9732e-04
Validation auc = 0.702888
Epoch 4150
Loss = 1.5971e-02, PNorm = 596.0266, GNorm = 0.9899, lr_0 = 9.9732e-04
Validation auc = 0.702431
Epoch 4151
Loss = 1.0555e-02, PNorm = 596.0607, GNorm = 0.8603, lr_0 = 9.9732e-04
Validation auc = 0.707843
Epoch 4152
Loss = 1.5342e-02, PNorm = 596.1011, GNorm = 0.3603, lr_0 = 9.9732e-04
Validation auc = 0.720316
Epoch 4153
Loss = 1.2687e-02, PNorm = 596.1504, GNorm = 0.1381, lr_0 = 9.9732e-04
Validation auc = 0.718768
Epoch 4154
Loss = 3.2479e-02, PNorm = 596.2004, GNorm = 0.6683, lr_0 = 9.9732e-04
Validation auc = 0.729075
Epoch 4155
Loss = 2.7141e-02, PNorm = 596.2596, GNorm = 0.2414, lr_0 = 9.9732e-04
Validation auc = 0.727350
Epoch 4156
Loss = 3.5473e-02, PNorm = 596.3156, GNorm = 1.5025, lr_0 = 9.9732e-04
Validation auc = 0.730655
Epoch 4157
Loss = 1.4042e-02, PNorm = 596.3702, GNorm = 0.0610, lr_0 = 9.9732e-04
Validation auc = 0.729991
Epoch 4158
Loss = 2.4366e-02, PNorm = 596.4285, GNorm = 0.4731, lr_0 = 9.9731e-04
Validation auc = 0.726796
Epoch 4159
Loss = 9.3545e-03, PNorm = 596.5104, GNorm = 0.3892, lr_0 = 9.9731e-04
Loss = 1.0585e-01, PNorm = 596.5875, GNorm = 10.2194, lr_0 = 9.9731e-04
Validation auc = 0.726669
Epoch 4160
Loss = 1.0302e-01, PNorm = 596.6818, GNorm = 0.8397, lr_0 = 9.9731e-04
Validation auc = 0.723003
Epoch 4161
Loss = 1.1392e-01, PNorm = 596.7544, GNorm = 3.4014, lr_0 = 9.9731e-04
Validation auc = 0.717360
Epoch 4162
Loss = 8.4379e-02, PNorm = 596.8211, GNorm = 0.5343, lr_0 = 9.9731e-04
Validation auc = 0.718822
Epoch 4163
Loss = 5.4830e-02, PNorm = 596.8927, GNorm = 2.5068, lr_0 = 9.9731e-04
Validation auc = 0.728809
Epoch 4164
Loss = 9.2884e-02, PNorm = 596.9620, GNorm = 1.1848, lr_0 = 9.9731e-04
Validation auc = 0.720616
Epoch 4165
Loss = 4.7085e-02, PNorm = 597.0402, GNorm = 1.8467, lr_0 = 9.9731e-04
Validation auc = 0.708772
Epoch 4166
Loss = 1.2040e-01, PNorm = 597.1165, GNorm = 10.1237, lr_0 = 9.9731e-04
Validation auc = 0.700895
Epoch 4167
Loss = 1.8127e-02, PNorm = 597.1870, GNorm = 1.3721, lr_0 = 9.9731e-04
Validation auc = 0.693467
Epoch 4168
Loss = 2.8123e-02, PNorm = 597.2624, GNorm = 0.7635, lr_0 = 9.9731e-04
Validation auc = 0.694914
Epoch 4169
Loss = 1.7078e-01, PNorm = 597.3354, GNorm = 3.3722, lr_0 = 9.9731e-04
Loss = 9.2476e-02, PNorm = 597.4105, GNorm = 0.4810, lr_0 = 9.9731e-04
Validation auc = 0.694933
Epoch 4170
Loss = 6.8688e-02, PNorm = 597.4765, GNorm = 0.2798, lr_0 = 9.9731e-04
Validation auc = 0.706866
Epoch 4171
Loss = 4.4411e-02, PNorm = 597.5280, GNorm = 0.6839, lr_0 = 9.9730e-04
Validation auc = 0.709499
Epoch 4172
Loss = 5.6955e-02, PNorm = 597.5950, GNorm = 2.6965, lr_0 = 9.9730e-04
Validation auc = 0.706851
Epoch 4173
Loss = 4.5792e-02, PNorm = 597.6532, GNorm = 1.1750, lr_0 = 9.9730e-04
Validation auc = 0.709694
Epoch 4174
Loss = 5.3937e-02, PNorm = 597.6961, GNorm = 1.2229, lr_0 = 9.9730e-04
Validation auc = 0.715541
Epoch 4175
Loss = 1.3549e-02, PNorm = 597.7384, GNorm = 0.7173, lr_0 = 9.9730e-04
Validation auc = 0.714120
Epoch 4176
Loss = 3.5417e-02, PNorm = 597.7978, GNorm = 0.8046, lr_0 = 9.9730e-04
Validation auc = 0.723605
Epoch 4177
Loss = 3.4871e-02, PNorm = 597.8584, GNorm = 0.3894, lr_0 = 9.9730e-04
Validation auc = 0.731470
Epoch 4178
Loss = 1.1915e-02, PNorm = 597.9153, GNorm = 0.1371, lr_0 = 9.9730e-04
Validation auc = 0.731431
Epoch 4179
Loss = 1.5566e-04, PNorm = 597.9652, GNorm = 0.0136, lr_0 = 9.9730e-04
Loss = 3.6713e-02, PNorm = 598.0090, GNorm = 0.0412, lr_0 = 9.9730e-04
Validation auc = 0.719767
Epoch 4180
Loss = 5.2512e-02, PNorm = 598.0531, GNorm = 3.9022, lr_0 = 9.9730e-04
Validation auc = 0.711733
Epoch 4181
Loss = 5.1129e-02, PNorm = 598.0990, GNorm = 0.5343, lr_0 = 9.9730e-04
Validation auc = 0.713096
Epoch 4182
Loss = 3.8784e-02, PNorm = 598.1448, GNorm = 0.1036, lr_0 = 9.9730e-04
Validation auc = 0.710068
Epoch 4183
Loss = 2.3674e-02, PNorm = 598.1852, GNorm = 0.0727, lr_0 = 9.9730e-04
Validation auc = 0.717134
Epoch 4184
Loss = 1.0527e-01, PNorm = 598.2225, GNorm = 0.3138, lr_0 = 9.9730e-04
Validation auc = 0.715577
Epoch 4185
Loss = 5.4074e-02, PNorm = 598.2997, GNorm = 0.6281, lr_0 = 9.9729e-04
Validation auc = 0.716955
Epoch 4186
Loss = 5.3452e-02, PNorm = 598.3691, GNorm = 1.2187, lr_0 = 9.9729e-04
Validation auc = 0.719940
Epoch 4187
Loss = 1.5069e-02, PNorm = 598.4285, GNorm = 1.5238, lr_0 = 9.9729e-04
Validation auc = 0.719863
Epoch 4188
Loss = 1.5710e-02, PNorm = 598.4728, GNorm = 0.1891, lr_0 = 9.9729e-04
Validation auc = 0.725482
Epoch 4189
Loss = 7.9203e-02, PNorm = 598.5035, GNorm = 1.3760, lr_0 = 9.9729e-04
Loss = 3.4006e-02, PNorm = 598.5361, GNorm = 0.0961, lr_0 = 9.9729e-04
Validation auc = 0.734194
Epoch 4190
Loss = 3.0022e-02, PNorm = 598.5815, GNorm = 0.1647, lr_0 = 9.9729e-04
Validation auc = 0.730766
Epoch 4191
Loss = 1.6709e-02, PNorm = 598.6198, GNorm = 0.0984, lr_0 = 9.9729e-04
Validation auc = 0.733652
Epoch 4192
Loss = 1.8702e-01, PNorm = 598.6783, GNorm = 2.2442, lr_0 = 9.9729e-04
Validation auc = 0.730771
Epoch 4193
Loss = 1.0534e-01, PNorm = 598.7787, GNorm = 0.1935, lr_0 = 9.9729e-04
Validation auc = 0.695278
Epoch 4194
Loss = 8.2869e-02, PNorm = 598.8854, GNorm = 0.7525, lr_0 = 9.9729e-04
Validation auc = 0.687755
Epoch 4195
Loss = 7.2301e-02, PNorm = 598.9694, GNorm = 3.2350, lr_0 = 9.9729e-04
Validation auc = 0.690374
Epoch 4196
Loss = 4.1573e-02, PNorm = 599.0350, GNorm = 1.8088, lr_0 = 9.9729e-04
Validation auc = 0.690220
Epoch 4197
Loss = 4.1941e-02, PNorm = 599.0887, GNorm = 1.8998, lr_0 = 9.9729e-04
Validation auc = 0.692252
Epoch 4198
Loss = 5.9523e-03, PNorm = 599.1339, GNorm = 0.0698, lr_0 = 9.9728e-04
Validation auc = 0.701187
Epoch 4199
Loss = 4.3060e-03, PNorm = 599.1670, GNorm = 0.2937, lr_0 = 9.9728e-04
Loss = 1.2659e-02, PNorm = 599.1989, GNorm = 0.1523, lr_0 = 9.9728e-04
Validation auc = 0.708641
Epoch 4200
Loss = 5.9318e-02, PNorm = 599.2383, GNorm = 0.0972, lr_0 = 9.9728e-04
Validation auc = 0.711871
Epoch 4201
Loss = 2.1476e-02, PNorm = 599.2915, GNorm = 0.6579, lr_0 = 9.9728e-04
Validation auc = 0.707254
Epoch 4202
Loss = 4.7363e-01, PNorm = 599.3516, GNorm = 1.5834, lr_0 = 9.9728e-04
Validation auc = 0.702659
Epoch 4203
Loss = 1.0527e-01, PNorm = 599.4816, GNorm = 4.5936, lr_0 = 9.9728e-04
Validation auc = 0.704483
Epoch 4204
Loss = 4.4354e-02, PNorm = 599.6228, GNorm = 0.5846, lr_0 = 9.9728e-04
Validation auc = 0.714772
Epoch 4205
Loss = 4.1452e-02, PNorm = 599.7139, GNorm = 1.7001, lr_0 = 9.9728e-04
Validation auc = 0.717543
Epoch 4206
Loss = 2.5373e-02, PNorm = 599.7868, GNorm = 0.8701, lr_0 = 9.9728e-04
Validation auc = 0.709524
Epoch 4207
Loss = 1.2100e-01, PNorm = 599.8576, GNorm = 3.2134, lr_0 = 9.9728e-04
Validation auc = 0.707623
Epoch 4208
Loss = 3.1513e-02, PNorm = 599.9426, GNorm = 3.0059, lr_0 = 9.9728e-04
Validation auc = 0.713702
Epoch 4209
Loss = 8.3267e-03, PNorm = 600.0371, GNorm = 0.3197, lr_0 = 9.9728e-04
Loss = 1.0877e-01, PNorm = 600.1240, GNorm = 2.0285, lr_0 = 9.9728e-04
Validation auc = 0.716777
Epoch 4210
Loss = 2.3453e-02, PNorm = 600.2055, GNorm = 1.6790, lr_0 = 9.9728e-04
Validation auc = 0.718800
Epoch 4211
Loss = 6.0664e-02, PNorm = 600.2796, GNorm = 1.6162, lr_0 = 9.9727e-04
Validation auc = 0.716357
Epoch 4212
Loss = 7.2718e-02, PNorm = 600.3761, GNorm = 2.5260, lr_0 = 9.9727e-04
Validation auc = 0.716382
Epoch 4213
Loss = 2.4598e-02, PNorm = 600.4747, GNorm = 2.0852, lr_0 = 9.9727e-04
Validation auc = 0.720754
Epoch 4214
Loss = 7.2842e-02, PNorm = 600.5704, GNorm = 7.6741, lr_0 = 9.9727e-04
Validation auc = 0.725135
Epoch 4215
Loss = 8.8459e-02, PNorm = 600.6760, GNorm = 10.9956, lr_0 = 9.9727e-04
Validation auc = 0.718223
Epoch 4216
Loss = 1.6794e-01, PNorm = 600.8088, GNorm = 3.2657, lr_0 = 9.9727e-04
Validation auc = 0.719975
Epoch 4217
Loss = 1.7208e-01, PNorm = 600.9368, GNorm = 3.1784, lr_0 = 9.9727e-04
Validation auc = 0.714472
Epoch 4218
Loss = 2.9051e-02, PNorm = 601.0558, GNorm = 0.6714, lr_0 = 9.9727e-04
Validation auc = 0.718657
Epoch 4219
Loss = 5.3821e-01, PNorm = 601.1493, GNorm = 7.5249, lr_0 = 9.9727e-04
Loss = 4.7444e-02, PNorm = 601.2302, GNorm = 2.5949, lr_0 = 9.9727e-04
Validation auc = 0.723797
Epoch 4220
Loss = 3.2396e-02, PNorm = 601.3039, GNorm = 0.2981, lr_0 = 9.9727e-04
Validation auc = 0.730096
Epoch 4221
Loss = 7.0302e-02, PNorm = 601.3625, GNorm = 0.7407, lr_0 = 9.9727e-04
Validation auc = 0.740009
Epoch 4222
Loss = 4.2066e-02, PNorm = 601.4248, GNorm = 5.0681, lr_0 = 9.9727e-04
Validation auc = 0.739966
Epoch 4223
Loss = 5.4062e-02, PNorm = 601.5152, GNorm = 2.7302, lr_0 = 9.9727e-04
Validation auc = 0.735337
Epoch 4224
Loss = 1.6960e-01, PNorm = 601.6193, GNorm = 11.4154, lr_0 = 9.9726e-04
Validation auc = 0.730611
Epoch 4225
Loss = 1.5371e-01, PNorm = 601.7400, GNorm = 0.5477, lr_0 = 9.9726e-04
Validation auc = 0.722299
Epoch 4226
Loss = 6.0629e-02, PNorm = 601.8806, GNorm = 2.8851, lr_0 = 9.9726e-04
Validation auc = 0.714563
Epoch 4227
Loss = 1.1773e-01, PNorm = 601.9897, GNorm = 1.9309, lr_0 = 9.9726e-04
Validation auc = 0.705130
Epoch 4228
Loss = 5.0073e-02, PNorm = 602.0671, GNorm = 1.0833, lr_0 = 9.9726e-04
Validation auc = 0.706474
Epoch 4229
Loss = 7.9719e-03, PNorm = 602.1312, GNorm = 0.4196, lr_0 = 9.9726e-04
Loss = 1.4028e-01, PNorm = 602.2129, GNorm = 2.8048, lr_0 = 9.9726e-04
Validation auc = 0.716758
Epoch 4230
Loss = 4.8264e-02, PNorm = 602.3015, GNorm = 1.2318, lr_0 = 9.9726e-04
Validation auc = 0.721866
Epoch 4231
Loss = 7.4286e-02, PNorm = 602.3732, GNorm = 3.7239, lr_0 = 9.9726e-04
Validation auc = 0.720192
Epoch 4232
Loss = 8.4321e-02, PNorm = 602.4594, GNorm = 0.7877, lr_0 = 9.9726e-04
Validation auc = 0.707583
Epoch 4233
Loss = 5.2804e-02, PNorm = 602.5437, GNorm = 1.6730, lr_0 = 9.9726e-04
Validation auc = 0.705895
Epoch 4234
Loss = 1.1414e-01, PNorm = 602.6017, GNorm = 4.9621, lr_0 = 9.9726e-04
Validation auc = 0.708619
Epoch 4235
Loss = 5.9441e-02, PNorm = 602.6670, GNorm = 2.5593, lr_0 = 9.9726e-04
Validation auc = 0.717020
Epoch 4236
Loss = 4.3536e-02, PNorm = 602.7298, GNorm = 2.7986, lr_0 = 9.9726e-04
Validation auc = 0.717272
Epoch 4237
Loss = 1.5351e-02, PNorm = 602.7813, GNorm = 0.4189, lr_0 = 9.9726e-04
Validation auc = 0.721143
Epoch 4238
Loss = 3.1186e-02, PNorm = 602.8232, GNorm = 0.1500, lr_0 = 9.9725e-04
Validation auc = 0.712857
Epoch 4239
Loss = 7.6697e-02, PNorm = 602.8654, GNorm = 1.5262, lr_0 = 9.9725e-04
Loss = 9.1155e-02, PNorm = 602.9381, GNorm = 2.3401, lr_0 = 9.9725e-04
Validation auc = 0.710324
Epoch 4240
Loss = 8.1728e-02, PNorm = 603.0589, GNorm = 6.8729, lr_0 = 9.9725e-04
Validation auc = 0.722107
Epoch 4241
Loss = 1.1375e-01, PNorm = 603.1563, GNorm = 3.3986, lr_0 = 9.9725e-04
Validation auc = 0.727184
Epoch 4242
Loss = 8.0466e-02, PNorm = 603.2317, GNorm = 0.9892, lr_0 = 9.9725e-04
Validation auc = 0.728106
Epoch 4243
Loss = 2.9472e-02, PNorm = 603.2925, GNorm = 2.7244, lr_0 = 9.9725e-04
Validation auc = 0.726858
Epoch 4244
Loss = 2.9633e-02, PNorm = 603.3461, GNorm = 1.1363, lr_0 = 9.9725e-04
Validation auc = 0.729011
Epoch 4245
Loss = 3.8553e-02, PNorm = 603.3905, GNorm = 0.4577, lr_0 = 9.9725e-04
Validation auc = 0.729415
Epoch 4246
Loss = 4.9303e-02, PNorm = 603.4277, GNorm = 1.8590, lr_0 = 9.9725e-04
Validation auc = 0.727552
Epoch 4247
Loss = 5.6916e-03, PNorm = 603.4603, GNorm = 0.7040, lr_0 = 9.9725e-04
Validation auc = 0.731877
Epoch 4248
Loss = 5.7267e-02, PNorm = 603.4995, GNorm = 0.2726, lr_0 = 9.9725e-04
Validation auc = 0.732227
Epoch 4249
Loss = 9.1676e-02, PNorm = 603.5447, GNorm = 2.6624, lr_0 = 9.9725e-04
Loss = 6.6485e-02, PNorm = 603.6058, GNorm = 6.9383, lr_0 = 9.9725e-04
Validation auc = 0.735106
Epoch 4250
Loss = 4.9336e-02, PNorm = 603.6745, GNorm = 2.7633, lr_0 = 9.9724e-04
Validation auc = 0.730988
Epoch 4251
Loss = 1.0848e-01, PNorm = 603.7410, GNorm = 1.8293, lr_0 = 9.9724e-04
Validation auc = 0.732790
Epoch 4252
Loss = 5.5135e-02, PNorm = 603.8039, GNorm = 1.1337, lr_0 = 9.9724e-04
Validation auc = 0.736496
Epoch 4253
Loss = 7.7734e-02, PNorm = 603.8523, GNorm = 3.3375, lr_0 = 9.9724e-04
Validation auc = 0.734851
Epoch 4254
Loss = 2.5392e-02, PNorm = 603.8980, GNorm = 0.8553, lr_0 = 9.9724e-04
Validation auc = 0.733001
Epoch 4255
Loss = 3.2727e-02, PNorm = 603.9358, GNorm = 0.5066, lr_0 = 9.9724e-04
Validation auc = 0.733633
Epoch 4256
Loss = 9.6471e-03, PNorm = 603.9661, GNorm = 0.6432, lr_0 = 9.9724e-04
Validation auc = 0.732086
Epoch 4257
Loss = 2.0463e-02, PNorm = 603.9952, GNorm = 2.5818, lr_0 = 9.9724e-04
Validation auc = 0.711338
Epoch 4258
Loss = 2.2808e-02, PNorm = 604.0460, GNorm = 0.7806, lr_0 = 9.9724e-04
Validation auc = 0.697248
Epoch 4259
Loss = 2.7282e-02, PNorm = 604.1446, GNorm = 1.1784, lr_0 = 9.9724e-04
Loss = 1.4003e-01, PNorm = 604.2271, GNorm = 0.4400, lr_0 = 9.9724e-04
Validation auc = 0.704658
Epoch 4260
Loss = 7.2730e-02, PNorm = 604.3435, GNorm = 2.7783, lr_0 = 9.9724e-04
Validation auc = 0.701203
Epoch 4261
Loss = 2.0789e-01, PNorm = 604.4752, GNorm = 0.5381, lr_0 = 9.9724e-04
Validation auc = 0.710498
Epoch 4262
Loss = 1.5902e-01, PNorm = 604.5761, GNorm = 0.9260, lr_0 = 9.9724e-04
Validation auc = 0.719464
Epoch 4263
Loss = 1.5108e-01, PNorm = 604.6835, GNorm = 2.3226, lr_0 = 9.9724e-04
Validation auc = 0.723552
Epoch 4264
Loss = 1.2617e-01, PNorm = 604.8010, GNorm = 2.8506, lr_0 = 9.9723e-04
Validation auc = 0.722826
Epoch 4265
Loss = 8.7711e-02, PNorm = 604.9307, GNorm = 4.2460, lr_0 = 9.9723e-04
Validation auc = 0.724153
Epoch 4266
Loss = 1.1025e-01, PNorm = 605.0929, GNorm = 1.4446, lr_0 = 9.9723e-04
Validation auc = 0.723501
Epoch 4267
Loss = 5.7780e-02, PNorm = 605.2198, GNorm = 1.4387, lr_0 = 9.9723e-04
Validation auc = 0.724119
Epoch 4268
Loss = 4.8694e-02, PNorm = 605.3125, GNorm = 1.6556, lr_0 = 9.9723e-04
Validation auc = 0.730494
Epoch 4269
Loss = 7.1087e-02, PNorm = 605.3974, GNorm = 2.7323, lr_0 = 9.9723e-04
Loss = 8.5137e-02, PNorm = 605.4625, GNorm = 9.5898, lr_0 = 9.9723e-04
Validation auc = 0.720835
Epoch 4270
Loss = 1.5855e-01, PNorm = 605.5401, GNorm = 1.6066, lr_0 = 9.9723e-04
Validation auc = 0.713904
Epoch 4271
Loss = 9.2978e-02, PNorm = 605.6474, GNorm = 1.0611, lr_0 = 9.9723e-04
Validation auc = 0.708934
Epoch 4272
Loss = 7.1023e-02, PNorm = 605.7249, GNorm = 6.4484, lr_0 = 9.9723e-04
Validation auc = 0.710520
Epoch 4273
Loss = 4.2801e-02, PNorm = 605.7985, GNorm = 0.5275, lr_0 = 9.9723e-04
Validation auc = 0.707498
Epoch 4274
Loss = 5.9821e-02, PNorm = 605.8699, GNorm = 5.5470, lr_0 = 9.9723e-04
Validation auc = 0.699167
Epoch 4275
Loss = 1.2402e-01, PNorm = 605.9273, GNorm = 0.3549, lr_0 = 9.9723e-04
Validation auc = 0.705925
Epoch 4276
Loss = 8.8265e-02, PNorm = 605.9865, GNorm = 5.7113, lr_0 = 9.9723e-04
Validation auc = 0.703785
Epoch 4277
Loss = 1.1543e-02, PNorm = 606.0445, GNorm = 0.2131, lr_0 = 9.9722e-04
Validation auc = 0.711149
Epoch 4278
Loss = 3.9473e-02, PNorm = 606.0986, GNorm = 3.1554, lr_0 = 9.9722e-04
Validation auc = 0.716230
Epoch 4279
Loss = 1.4978e-02, PNorm = 606.1449, GNorm = 0.5707, lr_0 = 9.9722e-04
Loss = 5.2067e-02, PNorm = 606.1887, GNorm = 0.4439, lr_0 = 9.9722e-04
Validation auc = 0.714707
Epoch 4280
Loss = 9.9196e-02, PNorm = 606.2351, GNorm = 0.4191, lr_0 = 9.9722e-04
Validation auc = 0.712423
Epoch 4281
Loss = 4.0447e-02, PNorm = 606.2863, GNorm = 0.9621, lr_0 = 9.9722e-04
Validation auc = 0.712689
Epoch 4282
Loss = 3.4694e-02, PNorm = 606.3288, GNorm = 5.2370, lr_0 = 9.9722e-04
Validation auc = 0.708607
Epoch 4283
Loss = 1.0375e-01, PNorm = 606.3795, GNorm = 1.0307, lr_0 = 9.9722e-04
Validation auc = 0.697446
Epoch 4284
Loss = 1.9461e-02, PNorm = 606.4392, GNorm = 2.9123, lr_0 = 9.9722e-04
Validation auc = 0.698475
Epoch 4285
Loss = 8.4567e-02, PNorm = 606.4826, GNorm = 7.1895, lr_0 = 9.9722e-04
Validation auc = 0.697388
Epoch 4286
Loss = 5.1980e-02, PNorm = 606.5213, GNorm = 1.7627, lr_0 = 9.9722e-04
Validation auc = 0.692378
Epoch 4287
Loss = 6.1789e-02, PNorm = 606.5739, GNorm = 0.5094, lr_0 = 9.9722e-04
Validation auc = 0.692602
Epoch 4288
Loss = 2.4505e-02, PNorm = 606.6361, GNorm = 1.9717, lr_0 = 9.9722e-04
Validation auc = 0.692950
Epoch 4289
Loss = 8.7208e-02, PNorm = 606.6934, GNorm = 4.7070, lr_0 = 9.9722e-04
Loss = 4.5880e-02, PNorm = 606.7562, GNorm = 0.6427, lr_0 = 9.9722e-04
Validation auc = 0.695505
Epoch 4290
Loss = 3.6506e-02, PNorm = 606.8099, GNorm = 3.5559, lr_0 = 9.9721e-04
Validation auc = 0.705436
Epoch 4291
Loss = 4.9828e-02, PNorm = 606.8636, GNorm = 0.3140, lr_0 = 9.9721e-04
Validation auc = 0.705895
Epoch 4292
Loss = 1.2011e-01, PNorm = 606.9107, GNorm = 1.2887, lr_0 = 9.9721e-04
Validation auc = 0.703289
Epoch 4293
Loss = 3.4525e-02, PNorm = 606.9587, GNorm = 2.0694, lr_0 = 9.9721e-04
Validation auc = 0.697760
Epoch 4294
Loss = 4.5525e-02, PNorm = 607.0047, GNorm = 0.1923, lr_0 = 9.9721e-04
Validation auc = 0.698857
Epoch 4295
Loss = 5.7702e-02, PNorm = 607.0578, GNorm = 0.8479, lr_0 = 9.9721e-04
Validation auc = 0.697630
Epoch 4296
Loss = 4.6656e-02, PNorm = 607.1134, GNorm = 4.0377, lr_0 = 9.9721e-04
Validation auc = 0.699412
Epoch 4297
Loss = 3.9144e-02, PNorm = 607.1653, GNorm = 2.8416, lr_0 = 9.9721e-04
Validation auc = 0.698474
Epoch 4298
Loss = 3.3890e-02, PNorm = 607.2192, GNorm = 1.5598, lr_0 = 9.9721e-04
Validation auc = 0.696853
Epoch 4299
Loss = 4.4429e-02, PNorm = 607.2768, GNorm = 2.6828, lr_0 = 9.9721e-04
Loss = 4.7056e-02, PNorm = 607.3382, GNorm = 1.3602, lr_0 = 9.9721e-04
Validation auc = 0.691764
Epoch 4300
Loss = 7.8901e-02, PNorm = 607.4006, GNorm = 3.6955, lr_0 = 9.9721e-04
Validation auc = 0.686229
Epoch 4301
Loss = 9.9360e-02, PNorm = 607.4803, GNorm = 5.9521, lr_0 = 9.9721e-04
Validation auc = 0.691938
Epoch 4302
Loss = 1.7852e-01, PNorm = 607.5635, GNorm = 1.3419, lr_0 = 9.9721e-04
Validation auc = 0.697249
Epoch 4303
Loss = 5.7856e-02, PNorm = 607.6528, GNorm = 0.6133, lr_0 = 9.9721e-04
Validation auc = 0.696390
Epoch 4304
Loss = 6.7636e-02, PNorm = 607.7191, GNorm = 2.7640, lr_0 = 9.9720e-04
Validation auc = 0.699296
Epoch 4305
Loss = 8.3380e-02, PNorm = 607.7797, GNorm = 2.0337, lr_0 = 9.9720e-04
Validation auc = 0.701707
Epoch 4306
Loss = 1.0115e-01, PNorm = 607.8349, GNorm = 0.9527, lr_0 = 9.9720e-04
Validation auc = 0.705196
Epoch 4307
Loss = 9.7513e-02, PNorm = 607.8900, GNorm = 1.1425, lr_0 = 9.9720e-04
Validation auc = 0.709067
Epoch 4308
Loss = 1.8771e-02, PNorm = 607.9490, GNorm = 1.1779, lr_0 = 9.9720e-04
Validation auc = 0.703516
Epoch 4309
Loss = 4.1117e-02, PNorm = 607.9974, GNorm = 1.0574, lr_0 = 9.9720e-04
Loss = 9.5482e-02, PNorm = 608.0589, GNorm = 4.4806, lr_0 = 9.9720e-04
Validation auc = 0.699454
Epoch 4310
Loss = 3.2269e-02, PNorm = 608.1220, GNorm = 1.3881, lr_0 = 9.9720e-04
Validation auc = 0.694441
Epoch 4311
Loss = 3.9033e-02, PNorm = 608.1749, GNorm = 0.5117, lr_0 = 9.9720e-04
Validation auc = 0.689228
Epoch 4312
Loss = 2.5962e-02, PNorm = 608.2146, GNorm = 1.8929, lr_0 = 9.9720e-04
Validation auc = 0.687585
Epoch 4313
Loss = 3.2932e-02, PNorm = 608.2474, GNorm = 0.2712, lr_0 = 9.9720e-04
Validation auc = 0.693433
Epoch 4314
Loss = 3.5096e-02, PNorm = 608.2791, GNorm = 2.2154, lr_0 = 9.9720e-04
Validation auc = 0.695511
Epoch 4315
Loss = 3.2208e-02, PNorm = 608.3111, GNorm = 3.8216, lr_0 = 9.9720e-04
Validation auc = 0.700217
Epoch 4316
Loss = 9.7121e-02, PNorm = 608.3527, GNorm = 10.5900, lr_0 = 9.9720e-04
Validation auc = 0.684601
Epoch 4317
Loss = 1.4340e-02, PNorm = 608.4084, GNorm = 1.0407, lr_0 = 9.9719e-04
Validation auc = 0.674185
Epoch 4318
Loss = 3.8656e-02, PNorm = 608.4484, GNorm = 1.4065, lr_0 = 9.9719e-04
Validation auc = 0.673680
Epoch 4319
Loss = 4.2952e-02, PNorm = 608.4870, GNorm = 3.0651, lr_0 = 9.9719e-04
Loss = 1.0176e-01, PNorm = 608.5391, GNorm = 0.7311, lr_0 = 9.9719e-04
Validation auc = 0.689738
Epoch 4320
Loss = 4.3066e-02, PNorm = 608.5968, GNorm = 5.1242, lr_0 = 9.9719e-04
Validation auc = 0.701934
Epoch 4321
Loss = 6.9315e-02, PNorm = 608.6522, GNorm = 0.5084, lr_0 = 9.9719e-04
Validation auc = 0.703553
Epoch 4322
Loss = 3.1353e-02, PNorm = 608.7061, GNorm = 2.5835, lr_0 = 9.9719e-04
Validation auc = 0.704196
Epoch 4323
Loss = 3.1490e-02, PNorm = 608.7535, GNorm = 1.2613, lr_0 = 9.9719e-04
Validation auc = 0.700946
Epoch 4324
Loss = 1.4243e-02, PNorm = 608.7894, GNorm = 0.5437, lr_0 = 9.9719e-04
Validation auc = 0.700556
Epoch 4325
Loss = 3.5884e-02, PNorm = 608.8146, GNorm = 0.6260, lr_0 = 9.9719e-04
Validation auc = 0.692431
Epoch 4326
Loss = 2.5886e-02, PNorm = 608.8543, GNorm = 1.6684, lr_0 = 9.9719e-04
Validation auc = 0.697833
Epoch 4327
Loss = 6.6851e-02, PNorm = 608.8987, GNorm = 0.3709, lr_0 = 9.9719e-04
Validation auc = 0.703804
Epoch 4328
Loss = 2.1046e-02, PNorm = 608.9408, GNorm = 1.5412, lr_0 = 9.9719e-04
Validation auc = 0.710180
Epoch 4329
Loss = 9.8145e-02, PNorm = 608.9727, GNorm = 2.2248, lr_0 = 9.9719e-04
Loss = 3.0265e-02, PNorm = 608.9988, GNorm = 0.0205, lr_0 = 9.9719e-04
Validation auc = 0.706913
Epoch 4330
Loss = 2.1065e-02, PNorm = 609.0217, GNorm = 0.4008, lr_0 = 9.9718e-04
Validation auc = 0.704807
Epoch 4331
Loss = 3.7394e-02, PNorm = 609.0457, GNorm = 3.7566, lr_0 = 9.9718e-04
Validation auc = 0.699311
Epoch 4332
Loss = 1.0424e-01, PNorm = 609.0782, GNorm = 0.3154, lr_0 = 9.9718e-04
Validation auc = 0.689300
Epoch 4333
Loss = 6.7063e-02, PNorm = 609.1136, GNorm = 0.5443, lr_0 = 9.9718e-04
Validation auc = 0.686891
Epoch 4334
Loss = 5.9294e-02, PNorm = 609.1558, GNorm = 1.1064, lr_0 = 9.9718e-04
Validation auc = 0.707070
Epoch 4335
Loss = 6.8133e-02, PNorm = 609.2038, GNorm = 3.7695, lr_0 = 9.9718e-04
Validation auc = 0.703250
Epoch 4336
Loss = 1.6297e-02, PNorm = 609.2523, GNorm = 1.0671, lr_0 = 9.9718e-04
Validation auc = 0.699174
Epoch 4337
Loss = 3.3711e-02, PNorm = 609.2981, GNorm = 2.8403, lr_0 = 9.9718e-04
Validation auc = 0.696251
Epoch 4338
Loss = 4.0385e-03, PNorm = 609.3426, GNorm = 0.3986, lr_0 = 9.9718e-04
Validation auc = 0.695354
Epoch 4339
Loss = 2.6447e-01, PNorm = 609.3872, GNorm = 8.1052, lr_0 = 9.9718e-04
Loss = 8.7513e-02, PNorm = 609.4427, GNorm = 0.5344, lr_0 = 9.9718e-04
Validation auc = 0.700749
Epoch 4340
Loss = 2.2121e-02, PNorm = 609.4976, GNorm = 0.6115, lr_0 = 9.9718e-04
Validation auc = 0.705327
Epoch 4341
Loss = 3.7801e-02, PNorm = 609.5490, GNorm = 2.8548, lr_0 = 9.9718e-04
Validation auc = 0.705539
Epoch 4342
Loss = 6.6230e-02, PNorm = 609.6058, GNorm = 0.8678, lr_0 = 9.9718e-04
Validation auc = 0.698362
Epoch 4343
Loss = 4.4287e-02, PNorm = 609.6592, GNorm = 4.4334, lr_0 = 9.9717e-04
Validation auc = 0.693510
Epoch 4344
Loss = 1.8854e-02, PNorm = 609.7201, GNorm = 0.2542, lr_0 = 9.9717e-04
Validation auc = 0.694478
Epoch 4345
Loss = 5.2255e-02, PNorm = 609.7769, GNorm = 0.2044, lr_0 = 9.9717e-04
Validation auc = 0.689428
Epoch 4346
Loss = 8.1198e-02, PNorm = 609.8225, GNorm = 4.7659, lr_0 = 9.9717e-04
Validation auc = 0.678462
Epoch 4347
Loss = 4.0999e-02, PNorm = 609.8726, GNorm = 1.0565, lr_0 = 9.9717e-04
Validation auc = 0.678218
Epoch 4348
Loss = 3.2082e-02, PNorm = 609.9196, GNorm = 1.0671, lr_0 = 9.9717e-04
Validation auc = 0.688007
Epoch 4349
Loss = 4.0501e-01, PNorm = 609.9702, GNorm = 8.4230, lr_0 = 9.9717e-04
Loss = 1.1804e-02, PNorm = 610.0241, GNorm = 0.1277, lr_0 = 9.9717e-04
Validation auc = 0.686462
Epoch 4350
Loss = 5.0267e-02, PNorm = 610.0704, GNorm = 0.5870, lr_0 = 9.9717e-04
Validation auc = 0.693990
Epoch 4351
Loss = 2.4585e-02, PNorm = 610.1134, GNorm = 1.2338, lr_0 = 9.9717e-04
Validation auc = 0.704602
Epoch 4352
Loss = 1.1161e-01, PNorm = 610.1632, GNorm = 9.1304, lr_0 = 9.9717e-04
Validation auc = 0.705010
Epoch 4353
Loss = 5.9022e-02, PNorm = 610.2226, GNorm = 1.8784, lr_0 = 9.9717e-04
Validation auc = 0.699745
Epoch 4354
Loss = 2.8392e-02, PNorm = 610.2770, GNorm = 0.3090, lr_0 = 9.9717e-04
Validation auc = 0.702538
Epoch 4355
Loss = 2.9892e-02, PNorm = 610.3194, GNorm = 0.6027, lr_0 = 9.9717e-04
Validation auc = 0.700628
Epoch 4356
Loss = 2.4064e-02, PNorm = 610.3615, GNorm = 1.8018, lr_0 = 9.9717e-04
Validation auc = 0.691505
Epoch 4357
Loss = 2.2931e-02, PNorm = 610.4156, GNorm = 0.9175, lr_0 = 9.9716e-04
Validation auc = 0.681305
Epoch 4358
Loss = 4.6851e-02, PNorm = 610.4801, GNorm = 3.7988, lr_0 = 9.9716e-04
Validation auc = 0.696068
Epoch 4359
Loss = 6.5004e-02, PNorm = 610.5473, GNorm = 3.7193, lr_0 = 9.9716e-04
Loss = 1.7465e-01, PNorm = 610.6246, GNorm = 7.2358, lr_0 = 9.9716e-04
Validation auc = 0.695076
Epoch 4360
Loss = 8.0790e-02, PNorm = 610.7216, GNorm = 4.0670, lr_0 = 9.9716e-04
Validation auc = 0.671684
Epoch 4361
Loss = 1.3968e-01, PNorm = 610.8146, GNorm = 1.1747, lr_0 = 9.9716e-04
Validation auc = 0.672688
Epoch 4362
Loss = 5.3057e-02, PNorm = 610.9119, GNorm = 1.0331, lr_0 = 9.9716e-04
Validation auc = 0.677544
Epoch 4363
Loss = 3.8905e-02, PNorm = 610.9846, GNorm = 3.2662, lr_0 = 9.9716e-04
Validation auc = 0.683107
Epoch 4364
Loss = 1.8298e-01, PNorm = 611.0423, GNorm = 2.6488, lr_0 = 9.9716e-04
Validation auc = 0.680827
Epoch 4365
Loss = 6.5455e-02, PNorm = 611.1112, GNorm = 0.8759, lr_0 = 9.9716e-04
Validation auc = 0.682233
Epoch 4366
Loss = 3.6036e-02, PNorm = 611.1687, GNorm = 1.5544, lr_0 = 9.9716e-04
Validation auc = 0.685901
Epoch 4367
Loss = 6.5022e-02, PNorm = 611.2150, GNorm = 3.5925, lr_0 = 9.9716e-04
Validation auc = 0.688257
Epoch 4368
Loss = 2.2889e-02, PNorm = 611.2540, GNorm = 1.4204, lr_0 = 9.9716e-04
Validation auc = 0.687753
Epoch 4369
Loss = 2.7561e-03, PNorm = 611.2841, GNorm = 0.2395, lr_0 = 9.9716e-04
Loss = 5.2346e-02, PNorm = 611.3204, GNorm = 8.3180, lr_0 = 9.9715e-04
Validation auc = 0.685694
Epoch 4370
Loss = 6.2379e-02, PNorm = 611.3682, GNorm = 0.8354, lr_0 = 9.9715e-04
Validation auc = 0.679888
Epoch 4371
Loss = 8.4476e-02, PNorm = 611.4241, GNorm = 1.1304, lr_0 = 9.9715e-04
Validation auc = 0.679593
Epoch 4372
Loss = 5.8640e-02, PNorm = 611.5065, GNorm = 0.4639, lr_0 = 9.9715e-04
Validation auc = 0.673622
Epoch 4373
Loss = 3.3201e-02, PNorm = 611.5812, GNorm = 0.8008, lr_0 = 9.9715e-04
Validation auc = 0.677155
Epoch 4374
Loss = 2.6552e-02, PNorm = 611.6484, GNorm = 1.2474, lr_0 = 9.9715e-04
Validation auc = 0.675093
Epoch 4375
Loss = 3.0482e-02, PNorm = 611.7030, GNorm = 1.5061, lr_0 = 9.9715e-04
Validation auc = 0.676919
Epoch 4376
Loss = 6.6771e-02, PNorm = 611.7446, GNorm = 0.2513, lr_0 = 9.9715e-04
Validation auc = 0.681352
Epoch 4377
Loss = 3.2654e-02, PNorm = 611.7820, GNorm = 2.7025, lr_0 = 9.9715e-04
Validation auc = 0.683325
Epoch 4378
Loss = 9.2008e-02, PNorm = 611.8233, GNorm = 3.8521, lr_0 = 9.9715e-04
Validation auc = 0.696708
Epoch 4379
Loss = 4.2686e-03, PNorm = 611.8668, GNorm = 0.2060, lr_0 = 9.9715e-04
Loss = 5.9550e-02, PNorm = 611.9123, GNorm = 1.0816, lr_0 = 9.9715e-04
Validation auc = 0.704732
Epoch 4380
Loss = 1.9603e-02, PNorm = 611.9631, GNorm = 0.2858, lr_0 = 9.9715e-04
Validation auc = 0.711644
Epoch 4381
Loss = 3.2991e-02, PNorm = 612.0120, GNorm = 0.1835, lr_0 = 9.9715e-04
Validation auc = 0.717197
Epoch 4382
Loss = 2.2937e-02, PNorm = 612.0517, GNorm = 1.6433, lr_0 = 9.9715e-04
Validation auc = 0.712826
Epoch 4383
Loss = 1.0202e-01, PNorm = 612.0889, GNorm = 0.4928, lr_0 = 9.9714e-04
Validation auc = 0.704567
Epoch 4384
Loss = 6.2779e-02, PNorm = 612.1387, GNorm = 4.3079, lr_0 = 9.9714e-04
Validation auc = 0.700610
Epoch 4385
Loss = 1.2740e-01, PNorm = 612.2275, GNorm = 6.3548, lr_0 = 9.9714e-04
Validation auc = 0.697707
Epoch 4386
Loss = 6.8768e-02, PNorm = 612.3331, GNorm = 0.2192, lr_0 = 9.9714e-04
Validation auc = 0.701447
Epoch 4387
Loss = 1.7821e-02, PNorm = 612.4014, GNorm = 0.5103, lr_0 = 9.9714e-04
Validation auc = 0.696078
Epoch 4388
Loss = 2.1910e-02, PNorm = 612.4581, GNorm = 0.8010, lr_0 = 9.9714e-04
Validation auc = 0.691779
Epoch 4389
Loss = 6.6315e-03, PNorm = 612.5086, GNorm = 0.3216, lr_0 = 9.9714e-04
Loss = 9.6497e-02, PNorm = 612.5499, GNorm = 0.3725, lr_0 = 9.9714e-04
Validation auc = 0.692044
Epoch 4390
Loss = 5.0514e-02, PNorm = 612.6019, GNorm = 4.0282, lr_0 = 9.9714e-04
Validation auc = 0.690933
Epoch 4391
Loss = 3.9929e-02, PNorm = 612.6705, GNorm = 3.9853, lr_0 = 9.9714e-04
Validation auc = 0.706858
Epoch 4392
Loss = 1.9490e-02, PNorm = 612.7342, GNorm = 0.1920, lr_0 = 9.9714e-04
Validation auc = 0.706417
Epoch 4393
Loss = 3.5121e-02, PNorm = 612.7792, GNorm = 1.3977, lr_0 = 9.9714e-04
Validation auc = 0.700181
Epoch 4394
Loss = 3.5565e-02, PNorm = 612.8102, GNorm = 5.2336, lr_0 = 9.9714e-04
Validation auc = 0.698717
Epoch 4395
Loss = 1.9325e-01, PNorm = 612.8615, GNorm = 8.4954, lr_0 = 9.9714e-04
Validation auc = 0.691988
Epoch 4396
Loss = 3.0458e-02, PNorm = 612.9382, GNorm = 0.4754, lr_0 = 9.9714e-04
Validation auc = 0.690004
Epoch 4397
Loss = 7.8133e-02, PNorm = 612.9974, GNorm = 0.8256, lr_0 = 9.9713e-04
Validation auc = 0.696125
Epoch 4398
Loss = 7.9040e-03, PNorm = 613.0558, GNorm = 0.4865, lr_0 = 9.9713e-04
Validation auc = 0.703810
Epoch 4399
Loss = 8.9589e-02, PNorm = 613.1142, GNorm = 3.4526, lr_0 = 9.9713e-04
Loss = 3.8002e-02, PNorm = 613.1759, GNorm = 1.6519, lr_0 = 9.9713e-04
Validation auc = 0.700787
Epoch 4400
Loss = 8.2125e-02, PNorm = 613.2492, GNorm = 0.2482, lr_0 = 9.9713e-04
Validation auc = 0.709369
Epoch 4401
Loss = 2.7377e-02, PNorm = 613.3139, GNorm = 0.8074, lr_0 = 9.9713e-04
Validation auc = 0.706886
Epoch 4402
Loss = 4.7306e-02, PNorm = 613.3552, GNorm = 5.7063, lr_0 = 9.9713e-04
Validation auc = 0.707958
Epoch 4403
Loss = 3.0719e-02, PNorm = 613.3959, GNorm = 1.8516, lr_0 = 9.9713e-04
Validation auc = 0.716146
Epoch 4404
Loss = 7.1171e-02, PNorm = 613.4321, GNorm = 4.0174, lr_0 = 9.9713e-04
Validation auc = 0.719840
Epoch 4405
Loss = 2.1883e-02, PNorm = 613.4687, GNorm = 0.8182, lr_0 = 9.9713e-04
Validation auc = 0.721665
Epoch 4406
Loss = 3.4597e-02, PNorm = 613.5011, GNorm = 2.9793, lr_0 = 9.9713e-04
Validation auc = 0.717283
Epoch 4407
Loss = 1.0890e-01, PNorm = 613.5454, GNorm = 4.7088, lr_0 = 9.9713e-04
Validation auc = 0.716469
Epoch 4408
Loss = 3.3987e-02, PNorm = 613.6018, GNorm = 0.5369, lr_0 = 9.9713e-04
Validation auc = 0.714449
Epoch 4409
Loss = 4.1974e-02, PNorm = 613.6486, GNorm = 2.6935, lr_0 = 9.9713e-04
Loss = 5.3375e-02, PNorm = 613.7023, GNorm = 0.3860, lr_0 = 9.9712e-04
Validation auc = 0.715330
Epoch 4410
Loss = 3.9581e-02, PNorm = 613.7572, GNorm = 0.3353, lr_0 = 9.9712e-04
Validation auc = 0.724451
Epoch 4411
Loss = 6.1416e-02, PNorm = 613.8043, GNorm = 2.4083, lr_0 = 9.9712e-04
Validation auc = 0.727138
Epoch 4412
Loss = 1.1227e-01, PNorm = 613.8538, GNorm = 0.4627, lr_0 = 9.9712e-04
Validation auc = 0.723430
Epoch 4413
Loss = 4.1386e-02, PNorm = 613.9144, GNorm = 0.1689, lr_0 = 9.9712e-04
Validation auc = 0.720186
Epoch 4414
Loss = 3.9039e-02, PNorm = 613.9587, GNorm = 0.2166, lr_0 = 9.9712e-04
Validation auc = 0.717154
Epoch 4415
Loss = 8.5424e-02, PNorm = 614.0021, GNorm = 1.3614, lr_0 = 9.9712e-04
Validation auc = 0.715391
Epoch 4416
Loss = 5.9524e-02, PNorm = 614.0557, GNorm = 1.9872, lr_0 = 9.9712e-04
Validation auc = 0.716915
Epoch 4417
Loss = 1.2832e-02, PNorm = 614.0963, GNorm = 1.4196, lr_0 = 9.9712e-04
Validation auc = 0.718879
Epoch 4418
Loss = 8.2134e-02, PNorm = 614.1291, GNorm = 0.8098, lr_0 = 9.9712e-04
Validation auc = 0.721890
Epoch 4419
Loss = 2.6582e-03, PNorm = 614.1658, GNorm = 0.1803, lr_0 = 9.9712e-04
Loss = 5.2272e-02, PNorm = 614.2075, GNorm = 0.6698, lr_0 = 9.9712e-04
Validation auc = 0.720918
Epoch 4420
Loss = 2.1353e-02, PNorm = 614.2534, GNorm = 3.6166, lr_0 = 9.9712e-04
Validation auc = 0.719946
Epoch 4421
Loss = 4.3168e-02, PNorm = 614.2912, GNorm = 5.0897, lr_0 = 9.9712e-04
Validation auc = 0.718897
Epoch 4422
Loss = 1.7217e-02, PNorm = 614.3306, GNorm = 0.4459, lr_0 = 9.9712e-04
Validation auc = 0.717964
Epoch 4423
Loss = 1.5478e-01, PNorm = 614.3619, GNorm = 1.3767, lr_0 = 9.9711e-04
Validation auc = 0.714863
Epoch 4424
Loss = 2.5616e-02, PNorm = 614.3941, GNorm = 0.4722, lr_0 = 9.9711e-04
Validation auc = 0.714395
Epoch 4425
Loss = 4.3299e-02, PNorm = 614.4292, GNorm = 0.7501, lr_0 = 9.9711e-04
Validation auc = 0.716754
Epoch 4426
Loss = 1.0115e-01, PNorm = 614.4778, GNorm = 0.7264, lr_0 = 9.9711e-04
Validation auc = 0.712315
Epoch 4427
Loss = 3.2034e-02, PNorm = 614.5254, GNorm = 0.1955, lr_0 = 9.9711e-04
Validation auc = 0.707389
Epoch 4428
Loss = 1.7323e-01, PNorm = 614.5735, GNorm = 0.5926, lr_0 = 9.9711e-04
Validation auc = 0.702764
Epoch 4429
Loss = 3.0389e-02, PNorm = 614.6371, GNorm = 1.2317, lr_0 = 9.9711e-04
Loss = 7.0407e-02, PNorm = 614.6898, GNorm = 0.4437, lr_0 = 9.9711e-04
Validation auc = 0.701440
Epoch 4430
Loss = 7.7365e-02, PNorm = 614.7383, GNorm = 5.5978, lr_0 = 9.9711e-04
Validation auc = 0.698682
Epoch 4431
Loss = 2.9667e-02, PNorm = 614.7839, GNorm = 2.7592, lr_0 = 9.9711e-04
Validation auc = 0.699249
Epoch 4432
Loss = 3.6759e-02, PNorm = 614.8240, GNorm = 6.0275, lr_0 = 9.9711e-04
Validation auc = 0.702627
Epoch 4433
Loss = 1.1715e-01, PNorm = 614.8638, GNorm = 4.3993, lr_0 = 9.9711e-04
Validation auc = 0.708988
Epoch 4434
Loss = 3.0354e-02, PNorm = 614.9066, GNorm = 1.5989, lr_0 = 9.9711e-04
Validation auc = 0.715109
Epoch 4435
Loss = 3.1436e-02, PNorm = 614.9426, GNorm = 0.4231, lr_0 = 9.9711e-04
Validation auc = 0.719778
Epoch 4436
Loss = 5.3662e-02, PNorm = 614.9801, GNorm = 0.1697, lr_0 = 9.9710e-04
Validation auc = 0.705214
Epoch 4437
Loss = 2.1585e-02, PNorm = 615.0272, GNorm = 1.0881, lr_0 = 9.9710e-04
Validation auc = 0.694760
Epoch 4438
Loss = 8.5635e-03, PNorm = 615.0691, GNorm = 0.6238, lr_0 = 9.9710e-04
Validation auc = 0.689909
Epoch 4439
Loss = 6.1560e-03, PNorm = 615.0999, GNorm = 0.3916, lr_0 = 9.9710e-04
Loss = 5.9609e-02, PNorm = 615.1257, GNorm = 0.2495, lr_0 = 9.9710e-04
Validation auc = 0.685345
Epoch 4440
Loss = 8.7744e-02, PNorm = 615.1767, GNorm = 1.2078, lr_0 = 9.9710e-04
Validation auc = 0.682479
Epoch 4441
Loss = 2.8969e-02, PNorm = 615.2272, GNorm = 2.0149, lr_0 = 9.9710e-04
Validation auc = 0.684142
Epoch 4442
Loss = 4.4437e-02, PNorm = 615.2721, GNorm = 0.6428, lr_0 = 9.9710e-04
Validation auc = 0.689328
Epoch 4443
Loss = 3.4991e-02, PNorm = 615.3192, GNorm = 0.2017, lr_0 = 9.9710e-04
Validation auc = 0.694321
Epoch 4444
Loss = 7.3273e-02, PNorm = 615.3587, GNorm = 4.4438, lr_0 = 9.9710e-04
Validation auc = 0.690380
Epoch 4445
Loss = 5.3442e-02, PNorm = 615.4310, GNorm = 1.8453, lr_0 = 9.9710e-04
Validation auc = 0.682490
Epoch 4446
Loss = 6.0745e-02, PNorm = 615.5087, GNorm = 2.9535, lr_0 = 9.9710e-04
Validation auc = 0.680699
Epoch 4447
Loss = 9.9052e-03, PNorm = 615.5733, GNorm = 0.8121, lr_0 = 9.9710e-04
Validation auc = 0.677735
Epoch 4448
Loss = 6.9268e-02, PNorm = 615.6265, GNorm = 0.3839, lr_0 = 9.9710e-04
Validation auc = 0.681022
Epoch 4449
Loss = 5.9088e-02, PNorm = 615.6717, GNorm = 1.5907, lr_0 = 9.9710e-04
Loss = 4.4744e-02, PNorm = 615.7092, GNorm = 4.7640, lr_0 = 9.9709e-04
Validation auc = 0.682575
Epoch 4450
Loss = 4.6051e-02, PNorm = 615.7651, GNorm = 0.3790, lr_0 = 9.9709e-04
Validation auc = 0.671160
Epoch 4451
Loss = 5.4377e-02, PNorm = 615.8204, GNorm = 2.5510, lr_0 = 9.9709e-04
Validation auc = 0.670561
Epoch 4452
Loss = 2.7462e-02, PNorm = 615.8705, GNorm = 0.4733, lr_0 = 9.9709e-04
Validation auc = 0.678801
Epoch 4453
Loss = 1.7726e-02, PNorm = 615.9126, GNorm = 0.2135, lr_0 = 9.9709e-04
Validation auc = 0.682914
Epoch 4454
Loss = 2.7757e-02, PNorm = 615.9466, GNorm = 0.7830, lr_0 = 9.9709e-04
Validation auc = 0.683178
Epoch 4455
Loss = 8.2371e-02, PNorm = 615.9843, GNorm = 2.0462, lr_0 = 9.9709e-04
Validation auc = 0.689477
Epoch 4456
Loss = 4.9374e-02, PNorm = 616.0377, GNorm = 0.3008, lr_0 = 9.9709e-04
Validation auc = 0.692284
Epoch 4457
Loss = 1.5011e-02, PNorm = 616.0801, GNorm = 1.2758, lr_0 = 9.9709e-04
Validation auc = 0.694355
Epoch 4458
Loss = 1.3947e-01, PNorm = 616.1211, GNorm = 5.0031, lr_0 = 9.9709e-04
Validation auc = 0.691101
Epoch 4459
Loss = 3.6281e-01, PNorm = 616.1869, GNorm = 13.3211, lr_0 = 9.9709e-04
Loss = 9.5127e-02, PNorm = 616.2816, GNorm = 2.2463, lr_0 = 9.9709e-04
Validation auc = 0.678267
Epoch 4460
Loss = 8.0730e-02, PNorm = 616.3535, GNorm = 0.2974, lr_0 = 9.9709e-04
Validation auc = 0.673435
Epoch 4461
Loss = 4.0098e-02, PNorm = 616.4058, GNorm = 0.3283, lr_0 = 9.9709e-04
Validation auc = 0.674603
Epoch 4462
Loss = 5.9165e-02, PNorm = 616.4556, GNorm = 0.0367, lr_0 = 9.9708e-04
Validation auc = 0.674611
Epoch 4463
Loss = 5.8961e-02, PNorm = 616.5212, GNorm = 1.3495, lr_0 = 9.9708e-04
Validation auc = 0.680624
Epoch 4464
Loss = 2.6343e-02, PNorm = 616.5813, GNorm = 3.9021, lr_0 = 9.9708e-04
Validation auc = 0.684219
Epoch 4465
Loss = 5.0872e-02, PNorm = 616.6307, GNorm = 0.0769, lr_0 = 9.9708e-04
Validation auc = 0.680530
Epoch 4466
Loss = 5.4541e-02, PNorm = 616.6871, GNorm = 2.5080, lr_0 = 9.9708e-04
Validation auc = 0.675368
Epoch 4467
Loss = 2.9315e-02, PNorm = 616.7453, GNorm = 4.4505, lr_0 = 9.9708e-04
Validation auc = 0.677072
Epoch 4468
Loss = 1.3747e-02, PNorm = 616.8126, GNorm = 0.5200, lr_0 = 9.9708e-04
Validation auc = 0.681088
Epoch 4469
Loss = 6.7204e-03, PNorm = 616.8898, GNorm = 0.4516, lr_0 = 9.9708e-04
Loss = 9.8634e-02, PNorm = 616.9659, GNorm = 1.7371, lr_0 = 9.9708e-04
Validation auc = 0.679685
Epoch 4470
Loss = 6.8929e-02, PNorm = 617.0373, GNorm = 1.4459, lr_0 = 9.9708e-04
Validation auc = 0.683554
Epoch 4471
Loss = 1.1564e-01, PNorm = 617.1060, GNorm = 1.5631, lr_0 = 9.9708e-04
Validation auc = 0.691127
Epoch 4472
Loss = 3.0188e-02, PNorm = 617.1866, GNorm = 1.1548, lr_0 = 9.9708e-04
Validation auc = 0.693289
Epoch 4473
Loss = 1.8222e-02, PNorm = 617.2397, GNorm = 0.1906, lr_0 = 9.9708e-04
Validation auc = 0.698081
Epoch 4474
Loss = 3.2379e-02, PNorm = 617.2791, GNorm = 0.5068, lr_0 = 9.9708e-04
Validation auc = 0.698599
Epoch 4475
Loss = 4.1742e-02, PNorm = 617.3159, GNorm = 0.1658, lr_0 = 9.9708e-04
Validation auc = 0.697665
Epoch 4476
Loss = 6.0495e-02, PNorm = 617.3728, GNorm = 3.1693, lr_0 = 9.9707e-04
Validation auc = 0.697639
Epoch 4477
Loss = 1.8793e-02, PNorm = 617.4326, GNorm = 0.4218, lr_0 = 9.9707e-04
Validation auc = 0.692637
Epoch 4478
Loss = 6.7895e-02, PNorm = 617.4860, GNorm = 0.6453, lr_0 = 9.9707e-04
Validation auc = 0.692942
Epoch 4479
Loss = 1.2345e-01, PNorm = 617.5348, GNorm = 4.6218, lr_0 = 9.9707e-04
Loss = 4.3891e-02, PNorm = 617.5890, GNorm = 1.7443, lr_0 = 9.9707e-04
Validation auc = 0.691035
Epoch 4480
Loss = 1.1050e-01, PNorm = 617.6409, GNorm = 10.4133, lr_0 = 9.9707e-04
Validation auc = 0.692351
Epoch 4481
Loss = 7.1490e-02, PNorm = 617.7150, GNorm = 1.1626, lr_0 = 9.9707e-04
Validation auc = 0.690740
Epoch 4482
Loss = 5.2386e-02, PNorm = 617.7845, GNorm = 0.4323, lr_0 = 9.9707e-04
Validation auc = 0.695003
Epoch 4483
Loss = 2.7602e-02, PNorm = 617.8350, GNorm = 1.2311, lr_0 = 9.9707e-04
Validation auc = 0.702882
Epoch 4484
Loss = 3.7970e-02, PNorm = 617.8736, GNorm = 1.5768, lr_0 = 9.9707e-04
Validation auc = 0.711261
Epoch 4485
Loss = 2.0558e-02, PNorm = 617.9080, GNorm = 0.2008, lr_0 = 9.9707e-04
Validation auc = 0.713577
Epoch 4486
Loss = 5.4891e-02, PNorm = 617.9457, GNorm = 3.4836, lr_0 = 9.9707e-04
Validation auc = 0.712554
Epoch 4487
Loss = 2.7963e-02, PNorm = 617.9843, GNorm = 0.9398, lr_0 = 9.9707e-04
Validation auc = 0.712848
Epoch 4488
Loss = 5.4676e-03, PNorm = 618.0324, GNorm = 0.5118, lr_0 = 9.9707e-04
Validation auc = 0.709481
Epoch 4489
Loss = 6.8075e-03, PNorm = 618.0752, GNorm = 0.4670, lr_0 = 9.9707e-04
Loss = 2.5589e-02, PNorm = 618.1076, GNorm = 6.8728, lr_0 = 9.9706e-04
Validation auc = 0.704382
Epoch 4490
Loss = 6.2650e-02, PNorm = 618.1527, GNorm = 0.2249, lr_0 = 9.9706e-04
Validation auc = 0.697623
Epoch 4491
Loss = 3.6437e-02, PNorm = 618.1891, GNorm = 0.2978, lr_0 = 9.9706e-04
Validation auc = 0.698358
Epoch 4492
Loss = 2.5378e-02, PNorm = 618.2278, GNorm = 2.3585, lr_0 = 9.9706e-04
Validation auc = 0.700587
Epoch 4493
Loss = 2.4019e-02, PNorm = 618.2673, GNorm = 0.3412, lr_0 = 9.9706e-04
Validation auc = 0.699966
Epoch 4494
Loss = 5.4768e-02, PNorm = 618.3043, GNorm = 0.2002, lr_0 = 9.9706e-04
Validation auc = 0.694492
Epoch 4495
Loss = 7.3927e-02, PNorm = 618.3507, GNorm = 0.9182, lr_0 = 9.9706e-04
Validation auc = 0.688157
Epoch 4496
Loss = 6.9879e-02, PNorm = 618.4077, GNorm = 0.0652, lr_0 = 9.9706e-04
Validation auc = 0.693041
Epoch 4497
Loss = 1.6678e-02, PNorm = 618.4645, GNorm = 3.0535, lr_0 = 9.9706e-04
Validation auc = 0.694785
Epoch 4498
Loss = 2.1456e-02, PNorm = 618.5171, GNorm = 0.9778, lr_0 = 9.9706e-04
Validation auc = 0.690493
Epoch 4499
Loss = 1.4287e-03, PNorm = 618.5651, GNorm = 0.0875, lr_0 = 9.9706e-04
Loss = 4.7964e-02, PNorm = 618.6124, GNorm = 0.3636, lr_0 = 9.9706e-04
Validation auc = 0.683833
Epoch 4500
Loss = 2.0959e-02, PNorm = 618.6499, GNorm = 0.9763, lr_0 = 9.9706e-04
Validation auc = 0.685571
Epoch 4501
Loss = 2.6169e-02, PNorm = 618.6827, GNorm = 3.3306, lr_0 = 9.9706e-04
Validation auc = 0.684497
Epoch 4502
Loss = 2.9124e-02, PNorm = 618.7325, GNorm = 2.0541, lr_0 = 9.9705e-04
Validation auc = 0.687726
Epoch 4503
Loss = 9.2511e-02, PNorm = 618.7961, GNorm = 0.1377, lr_0 = 9.9705e-04
Validation auc = 0.690584
Epoch 4504
Loss = 7.4087e-02, PNorm = 618.8637, GNorm = 4.7874, lr_0 = 9.9705e-04
Validation auc = 0.692748
Epoch 4505
Loss = 3.4902e-02, PNorm = 618.9326, GNorm = 3.4707, lr_0 = 9.9705e-04
Validation auc = 0.696688
Epoch 4506
Loss = 2.4898e-02, PNorm = 618.9960, GNorm = 0.7635, lr_0 = 9.9705e-04
Validation auc = 0.692267
Epoch 4507
Loss = 3.4834e-02, PNorm = 619.0614, GNorm = 1.9334, lr_0 = 9.9705e-04
Validation auc = 0.695649
Epoch 4508
Loss = 1.9321e-02, PNorm = 619.1174, GNorm = 0.8045, lr_0 = 9.9705e-04
Validation auc = 0.697701
Epoch 4509
Loss = 8.5492e-02, PNorm = 619.1589, GNorm = 2.2181, lr_0 = 9.9705e-04
Loss = 5.3289e-02, PNorm = 619.1994, GNorm = 0.6663, lr_0 = 9.9705e-04
Validation auc = 0.698514
Epoch 4510
Loss = 2.1077e-02, PNorm = 619.2387, GNorm = 0.5328, lr_0 = 9.9705e-04
Validation auc = 0.696203
Epoch 4511
Loss = 3.2204e-02, PNorm = 619.2656, GNorm = 3.4569, lr_0 = 9.9705e-04
Validation auc = 0.695995
Epoch 4512
Loss = 2.7680e-02, PNorm = 619.2971, GNorm = 1.7700, lr_0 = 9.9705e-04
Validation auc = 0.691278
Epoch 4513
Loss = 3.3491e-02, PNorm = 619.3467, GNorm = 3.0006, lr_0 = 9.9705e-04
Validation auc = 0.688171
Epoch 4514
Loss = 2.2756e-02, PNorm = 619.4078, GNorm = 1.1191, lr_0 = 9.9705e-04
Validation auc = 0.684817
Epoch 4515
Loss = 4.8888e-02, PNorm = 619.4559, GNorm = 5.9455, lr_0 = 9.9705e-04
Validation auc = 0.686529
Epoch 4516
Loss = 1.8926e-02, PNorm = 619.5043, GNorm = 0.7793, lr_0 = 9.9704e-04
Validation auc = 0.681488
Epoch 4517
Loss = 4.2528e-02, PNorm = 619.5596, GNorm = 1.0011, lr_0 = 9.9704e-04
Validation auc = 0.665901
Epoch 4518
Loss = 4.5318e-02, PNorm = 619.6415, GNorm = 0.5562, lr_0 = 9.9704e-04
Validation auc = 0.660894
Epoch 4519
Loss = 6.5222e-02, PNorm = 619.7220, GNorm = 3.6713, lr_0 = 9.9704e-04
Loss = 7.9315e-02, PNorm = 619.7944, GNorm = 11.0225, lr_0 = 9.9704e-04
Validation auc = 0.655796
Epoch 4520
Loss = 2.0160e-01, PNorm = 619.8871, GNorm = 2.2723, lr_0 = 9.9704e-04
Validation auc = 0.662212
Epoch 4521
Loss = 5.2903e-02, PNorm = 620.0253, GNorm = 1.8542, lr_0 = 9.9704e-04
Validation auc = 0.666293
Epoch 4522
Loss = 1.1794e-01, PNorm = 620.1256, GNorm = 7.4638, lr_0 = 9.9704e-04
Validation auc = 0.667998
Epoch 4523
Loss = 6.8574e-02, PNorm = 620.2023, GNorm = 3.9173, lr_0 = 9.9704e-04
Validation auc = 0.675842
Epoch 4524
Loss = 6.4364e-02, PNorm = 620.2715, GNorm = 3.2301, lr_0 = 9.9704e-04
Validation auc = 0.676642
Epoch 4525
Loss = 1.4921e-01, PNorm = 620.3699, GNorm = 0.2928, lr_0 = 9.9704e-04
Validation auc = 0.668919
Epoch 4526
Loss = 1.2614e-01, PNorm = 620.4720, GNorm = 3.9408, lr_0 = 9.9704e-04
Validation auc = 0.654706
Epoch 4527
Loss = 1.0407e-01, PNorm = 620.5793, GNorm = 1.6529, lr_0 = 9.9704e-04
Validation auc = 0.665097
Epoch 4528
Loss = 8.7089e-02, PNorm = 620.6674, GNorm = 0.8198, lr_0 = 9.9704e-04
Validation auc = 0.680455
Epoch 4529
Loss = 4.1350e-02, PNorm = 620.7571, GNorm = 1.6457, lr_0 = 9.9703e-04
Loss = 7.0393e-02, PNorm = 620.8469, GNorm = 1.0295, lr_0 = 9.9703e-04
Validation auc = 0.683951
Epoch 4530
Loss = 4.0935e-02, PNorm = 620.9222, GNorm = 0.9123, lr_0 = 9.9703e-04
Validation auc = 0.684750
Epoch 4531
Loss = 3.3865e-02, PNorm = 620.9776, GNorm = 4.1634, lr_0 = 9.9703e-04
Validation auc = 0.684015
Epoch 4532
Loss = 8.9545e-02, PNorm = 621.0197, GNorm = 1.4108, lr_0 = 9.9703e-04
Validation auc = 0.684439
Epoch 4533
Loss = 5.7677e-02, PNorm = 621.0695, GNorm = 1.5364, lr_0 = 9.9703e-04
Validation auc = 0.681940
Epoch 4534
Loss = 9.4127e-02, PNorm = 621.1188, GNorm = 6.5645, lr_0 = 9.9703e-04
Validation auc = 0.677680
Epoch 4535
Loss = 3.6887e-02, PNorm = 621.1803, GNorm = 0.6239, lr_0 = 9.9703e-04
Validation auc = 0.673855
Epoch 4536
Loss = 1.2343e-02, PNorm = 621.2288, GNorm = 0.5193, lr_0 = 9.9703e-04
Validation auc = 0.662634
Epoch 4537
Loss = 6.1865e-02, PNorm = 621.2851, GNorm = 3.2054, lr_0 = 9.9703e-04
Validation auc = 0.661742
Epoch 4538
Loss = 3.0733e-02, PNorm = 621.3511, GNorm = 0.6818, lr_0 = 9.9703e-04
Validation auc = 0.677971
Epoch 4539
Loss = 7.7284e-03, PNorm = 621.4252, GNorm = 0.2763, lr_0 = 9.9703e-04
Loss = 6.7440e-02, PNorm = 621.4794, GNorm = 1.4272, lr_0 = 9.9703e-04
Validation auc = 0.680024
Epoch 4540
Loss = 4.7305e-02, PNorm = 621.5271, GNorm = 2.2682, lr_0 = 9.9703e-04
Validation auc = 0.678386
Epoch 4541
Loss = 6.4438e-02, PNorm = 621.5780, GNorm = 3.8228, lr_0 = 9.9703e-04
Validation auc = 0.683982
Epoch 4542
Loss = 3.6197e-02, PNorm = 621.6177, GNorm = 1.0158, lr_0 = 9.9702e-04
Validation auc = 0.684714
Epoch 4543
Loss = 6.1169e-02, PNorm = 621.6549, GNorm = 0.5929, lr_0 = 9.9702e-04
Validation auc = 0.679480
Epoch 4544
Loss = 1.0889e-01, PNorm = 621.7069, GNorm = 0.4196, lr_0 = 9.9702e-04
Validation auc = 0.674675
Epoch 4545
Loss = 1.0515e-01, PNorm = 621.7674, GNorm = 0.6420, lr_0 = 9.9702e-04
Validation auc = 0.677873
Epoch 4546
Loss = 2.9947e-02, PNorm = 621.8279, GNorm = 1.6027, lr_0 = 9.9702e-04
Validation auc = 0.684949
Epoch 4547
Loss = 4.1558e-02, PNorm = 621.8786, GNorm = 0.3731, lr_0 = 9.9702e-04
Validation auc = 0.688498
Epoch 4548
Loss = 6.4874e-02, PNorm = 621.9179, GNorm = 0.3491, lr_0 = 9.9702e-04
Validation auc = 0.693566
Epoch 4549
Loss = 1.6017e-02, PNorm = 621.9618, GNorm = 0.7693, lr_0 = 9.9702e-04
Loss = 5.3664e-02, PNorm = 622.0008, GNorm = 1.7262, lr_0 = 9.9702e-04
Validation auc = 0.694996
Epoch 4550
Loss = 1.3808e-02, PNorm = 622.0329, GNorm = 0.5821, lr_0 = 9.9702e-04
Validation auc = 0.696316
Epoch 4551
Loss = 8.1791e-02, PNorm = 622.0584, GNorm = 2.2781, lr_0 = 9.9702e-04
Validation auc = 0.689910
Epoch 4552
Loss = 4.1012e-02, PNorm = 622.0964, GNorm = 2.1059, lr_0 = 9.9702e-04
Validation auc = 0.684184
Epoch 4553
Loss = 2.7009e-02, PNorm = 622.1321, GNorm = 1.9215, lr_0 = 9.9702e-04
Validation auc = 0.678039
Epoch 4554
Loss = 3.5251e-02, PNorm = 622.1669, GNorm = 0.9649, lr_0 = 9.9702e-04
Validation auc = 0.676898
Epoch 4555
Loss = 9.3929e-03, PNorm = 622.2090, GNorm = 0.1953, lr_0 = 9.9701e-04
Validation auc = 0.678553
Epoch 4556
Loss = 3.6617e-02, PNorm = 622.2472, GNorm = 2.3121, lr_0 = 9.9701e-04
Validation auc = 0.680250
Epoch 4557
Loss = 5.0017e-02, PNorm = 622.2855, GNorm = 4.7241, lr_0 = 9.9701e-04
Validation auc = 0.676933
Epoch 4558
Loss = 2.6460e-02, PNorm = 622.3253, GNorm = 1.6014, lr_0 = 9.9701e-04
Validation auc = 0.674652
Epoch 4559
Loss = 1.1305e-01, PNorm = 622.3560, GNorm = 4.9076, lr_0 = 9.9701e-04
Loss = 5.1859e-03, PNorm = 622.3871, GNorm = 0.2645, lr_0 = 9.9701e-04
Validation auc = 0.674571
Epoch 4560
Loss = 5.4601e-02, PNorm = 622.4132, GNorm = 3.6143, lr_0 = 9.9701e-04
Validation auc = 0.673948
Epoch 4561
Loss = 5.9603e-02, PNorm = 622.4466, GNorm = 1.2857, lr_0 = 9.9701e-04
Validation auc = 0.673848
Epoch 4562
Loss = 6.9783e-02, PNorm = 622.5044, GNorm = 1.8205, lr_0 = 9.9701e-04
Validation auc = 0.674533
Epoch 4563
Loss = 2.1561e-02, PNorm = 622.5604, GNorm = 1.8671, lr_0 = 9.9701e-04
Validation auc = 0.669615
Epoch 4564
Loss = 2.7230e-02, PNorm = 622.6041, GNorm = 0.9540, lr_0 = 9.9701e-04
Validation auc = 0.667724
Epoch 4565
Loss = 1.9735e-01, PNorm = 622.6364, GNorm = 11.6211, lr_0 = 9.9701e-04
Validation auc = 0.672093
Epoch 4566
Loss = 3.5754e-02, PNorm = 622.6755, GNorm = 0.9954, lr_0 = 9.9701e-04
Validation auc = 0.672254
Epoch 4567
Loss = 2.5703e-02, PNorm = 622.7285, GNorm = 0.9250, lr_0 = 9.9701e-04
Validation auc = 0.669749
Epoch 4568
Loss = 1.1887e-02, PNorm = 622.7686, GNorm = 1.0109, lr_0 = 9.9701e-04
Validation auc = 0.669225
Epoch 4569
Loss = 2.8251e-03, PNorm = 622.7943, GNorm = 0.1654, lr_0 = 9.9700e-04
Loss = 1.5724e-02, PNorm = 622.8103, GNorm = 2.0903, lr_0 = 9.9700e-04
Validation auc = 0.671191
Epoch 4570
Loss = 6.4926e-02, PNorm = 622.8267, GNorm = 4.8142, lr_0 = 9.9700e-04
Validation auc = 0.673767
Epoch 4571
Loss = 1.7449e-02, PNorm = 622.8493, GNorm = 0.0567, lr_0 = 9.9700e-04
Validation auc = 0.676387
Epoch 4572
Loss = 1.8482e-02, PNorm = 622.8761, GNorm = 0.4051, lr_0 = 9.9700e-04
Validation auc = 0.679727
Epoch 4573
Loss = 8.2695e-02, PNorm = 622.9050, GNorm = 4.5473, lr_0 = 9.9700e-04
Validation auc = 0.675180
Epoch 4574
Loss = 4.5322e-02, PNorm = 622.9354, GNorm = 4.1608, lr_0 = 9.9700e-04
Validation auc = 0.672474
Epoch 4575
Loss = 1.0095e-01, PNorm = 622.9729, GNorm = 1.7547, lr_0 = 9.9700e-04
Validation auc = 0.670606
Epoch 4576
Loss = 3.7466e-02, PNorm = 623.0145, GNorm = 1.2194, lr_0 = 9.9700e-04
Validation auc = 0.668253
Epoch 4577
Loss = 3.5904e-02, PNorm = 623.0513, GNorm = 2.1441, lr_0 = 9.9700e-04
Validation auc = 0.657893
Epoch 4578
Loss = 2.4264e-02, PNorm = 623.0962, GNorm = 3.2326, lr_0 = 9.9700e-04
Validation auc = 0.652980
Epoch 4579
Loss = 1.1798e-02, PNorm = 623.1385, GNorm = 0.8282, lr_0 = 9.9700e-04
Loss = 1.9284e-02, PNorm = 623.1807, GNorm = 3.9636, lr_0 = 9.9700e-04
Validation auc = 0.653966
Epoch 4580
Loss = 3.4614e-02, PNorm = 623.2227, GNorm = 2.9620, lr_0 = 9.9700e-04
Validation auc = 0.661436
Epoch 4581
Loss = 3.9291e-02, PNorm = 623.2628, GNorm = 2.3834, lr_0 = 9.9700e-04
Validation auc = 0.670654
Epoch 4582
Loss = 4.7448e-02, PNorm = 623.3067, GNorm = 1.0553, lr_0 = 9.9699e-04
Validation auc = 0.691146
Epoch 4583
Loss = 5.2771e-02, PNorm = 623.3762, GNorm = 1.1589, lr_0 = 9.9699e-04
Validation auc = 0.708887
Epoch 4584
Loss = 8.1895e-03, PNorm = 623.4488, GNorm = 0.3815, lr_0 = 9.9699e-04
Validation auc = 0.712999
Epoch 4585
Loss = 1.7785e-02, PNorm = 623.4995, GNorm = 0.6618, lr_0 = 9.9699e-04
Validation auc = 0.710115
Epoch 4586
Loss = 7.7441e-02, PNorm = 623.5629, GNorm = 6.2843, lr_0 = 9.9699e-04
Validation auc = 0.709494
Epoch 4587
Loss = 5.2802e-02, PNorm = 623.6266, GNorm = 1.7706, lr_0 = 9.9699e-04
Validation auc = 0.710342
Epoch 4588
Loss = 3.2176e-02, PNorm = 623.6830, GNorm = 4.2510, lr_0 = 9.9699e-04
Validation auc = 0.705064
Epoch 4589
Loss = 8.0191e-02, PNorm = 623.7450, GNorm = 2.3122, lr_0 = 9.9699e-04
Loss = 2.3656e-02, PNorm = 623.8013, GNorm = 0.5225, lr_0 = 9.9699e-04
Validation auc = 0.705176
Epoch 4590
Loss = 3.8737e-02, PNorm = 623.8483, GNorm = 0.4298, lr_0 = 9.9699e-04
Validation auc = 0.706876
Epoch 4591
Loss = 3.7024e-02, PNorm = 623.9003, GNorm = 4.1479, lr_0 = 9.9699e-04
Validation auc = 0.708821
Epoch 4592
Loss = 3.8943e-02, PNorm = 623.9558, GNorm = 1.2897, lr_0 = 9.9699e-04
Validation auc = 0.709211
Epoch 4593
Loss = 2.1457e-01, PNorm = 624.0092, GNorm = 0.6092, lr_0 = 9.9699e-04
Validation auc = 0.708462
Epoch 4594
Loss = 5.4661e-02, PNorm = 624.0926, GNorm = 2.1430, lr_0 = 9.9699e-04
Validation auc = 0.704123
Epoch 4595
Loss = 2.5917e-02, PNorm = 624.1630, GNorm = 1.3523, lr_0 = 9.9698e-04
Validation auc = 0.693444
Epoch 4596
Loss = 4.0442e-02, PNorm = 624.2192, GNorm = 0.3086, lr_0 = 9.9698e-04
Validation auc = 0.686450
Epoch 4597
Loss = 2.3871e-02, PNorm = 624.2625, GNorm = 1.2766, lr_0 = 9.9698e-04
Validation auc = 0.683952
Epoch 4598
Loss = 7.1822e-03, PNorm = 624.2977, GNorm = 0.2649, lr_0 = 9.9698e-04
Validation auc = 0.690721
Epoch 4599
Loss = 5.7137e-03, PNorm = 624.3280, GNorm = 0.3362, lr_0 = 9.9698e-04
Loss = 3.5043e-02, PNorm = 624.3615, GNorm = 2.6624, lr_0 = 9.9698e-04
Validation auc = 0.692076
Epoch 4600
Loss = 3.5102e-02, PNorm = 624.3992, GNorm = 0.0362, lr_0 = 9.9698e-04
Validation auc = 0.690320
Epoch 4601
Loss = 2.4059e-02, PNorm = 624.4329, GNorm = 1.9695, lr_0 = 9.9698e-04
Validation auc = 0.689579
Epoch 4602
Loss = 2.3533e-02, PNorm = 624.4617, GNorm = 0.1635, lr_0 = 9.9698e-04
Validation auc = 0.683516
Epoch 4603
Loss = 7.6716e-02, PNorm = 624.4990, GNorm = 0.2172, lr_0 = 9.9698e-04
Validation auc = 0.680892
Epoch 4604
Loss = 3.5482e-02, PNorm = 624.5394, GNorm = 0.4125, lr_0 = 9.9698e-04
Validation auc = 0.678804
Epoch 4605
Loss = 3.6799e-02, PNorm = 624.5810, GNorm = 1.9258, lr_0 = 9.9698e-04
Validation auc = 0.680974
Epoch 4606
Loss = 8.9228e-03, PNorm = 624.6315, GNorm = 0.3507, lr_0 = 9.9698e-04
Validation auc = 0.678707
Epoch 4607
Loss = 4.7412e-02, PNorm = 624.6711, GNorm = 1.4000, lr_0 = 9.9698e-04
Validation auc = 0.671497
Epoch 4608
Loss = 1.9811e-02, PNorm = 624.7172, GNorm = 2.3109, lr_0 = 9.9698e-04
Validation auc = 0.670557
Epoch 4609
Loss = 5.9640e-02, PNorm = 624.7689, GNorm = 6.1793, lr_0 = 9.9697e-04
Loss = 4.7267e-02, PNorm = 624.8313, GNorm = 0.5099, lr_0 = 9.9697e-04
Validation auc = 0.672694
Epoch 4610
Loss = 7.4906e-02, PNorm = 624.8782, GNorm = 12.1138, lr_0 = 9.9697e-04
Validation auc = 0.675699
Epoch 4611
Loss = 2.8981e-02, PNorm = 624.9253, GNorm = 2.4472, lr_0 = 9.9697e-04
Validation auc = 0.681197
Epoch 4612
Loss = 1.0841e-01, PNorm = 624.9762, GNorm = 4.1474, lr_0 = 9.9697e-04
Validation auc = 0.680123
Epoch 4613
Loss = 7.6711e-02, PNorm = 625.0450, GNorm = 2.0738, lr_0 = 9.9697e-04
Validation auc = 0.688902
Epoch 4614
Loss = 7.8904e-02, PNorm = 625.1136, GNorm = 4.4508, lr_0 = 9.9697e-04
Validation auc = 0.685967
Epoch 4615
Loss = 4.3989e-02, PNorm = 625.1830, GNorm = 1.9044, lr_0 = 9.9697e-04
Validation auc = 0.682805
Epoch 4616
Loss = 3.1133e-02, PNorm = 625.2454, GNorm = 3.4739, lr_0 = 9.9697e-04
Validation auc = 0.690358
Epoch 4617
Loss = 1.9385e-02, PNorm = 625.2974, GNorm = 0.8106, lr_0 = 9.9697e-04
Validation auc = 0.698391
Epoch 4618
Loss = 1.1165e-01, PNorm = 625.3515, GNorm = 5.9086, lr_0 = 9.9697e-04
Validation auc = 0.703017
Epoch 4619
Loss = 4.8861e-02, PNorm = 625.4088, GNorm = 1.8940, lr_0 = 9.9697e-04
Loss = 3.3584e-02, PNorm = 625.4807, GNorm = 0.4939, lr_0 = 9.9697e-04
Validation auc = 0.707999
Epoch 4620
Loss = 8.3803e-02, PNorm = 625.5566, GNorm = 5.7898, lr_0 = 9.9697e-04
Validation auc = 0.699312
Epoch 4621
Loss = 1.7510e-02, PNorm = 625.6277, GNorm = 1.2882, lr_0 = 9.9696e-04
Validation auc = 0.697601
Epoch 4622
Loss = 1.1404e-02, PNorm = 625.6772, GNorm = 1.6166, lr_0 = 9.9696e-04
Validation auc = 0.704605
Epoch 4623
Loss = 7.1507e-02, PNorm = 625.7240, GNorm = 0.5404, lr_0 = 9.9696e-04
Validation auc = 0.706362
Epoch 4624
Loss = 5.9198e-02, PNorm = 625.7820, GNorm = 0.5278, lr_0 = 9.9696e-04
Validation auc = 0.704726
Epoch 4625
Loss = 7.5469e-02, PNorm = 625.8392, GNorm = 2.4655, lr_0 = 9.9696e-04
Validation auc = 0.697694
Epoch 4626
Loss = 1.6326e-01, PNorm = 625.8987, GNorm = 9.6512, lr_0 = 9.9696e-04
Validation auc = 0.686947
Epoch 4627
Loss = 6.5193e-02, PNorm = 625.9606, GNorm = 1.5244, lr_0 = 9.9696e-04
Validation auc = 0.682476
Epoch 4628
Loss = 2.9057e-02, PNorm = 626.0123, GNorm = 0.5212, lr_0 = 9.9696e-04
Validation auc = 0.681882
Epoch 4629
Loss = 2.7166e-02, PNorm = 626.0499, GNorm = 1.7095, lr_0 = 9.9696e-04
Loss = 2.6166e-02, PNorm = 626.0912, GNorm = 0.3329, lr_0 = 9.9696e-04
Validation auc = 0.679199
Epoch 4630
Loss = 4.2788e-02, PNorm = 626.1266, GNorm = 1.5296, lr_0 = 9.9696e-04
Validation auc = 0.682736
Epoch 4631
Loss = 9.6797e-02, PNorm = 626.1704, GNorm = 1.4775, lr_0 = 9.9696e-04
Validation auc = 0.680407
Epoch 4632
Loss = 3.6965e-02, PNorm = 626.2363, GNorm = 0.7316, lr_0 = 9.9696e-04
Validation auc = 0.669817
Epoch 4633
Loss = 3.5091e-02, PNorm = 626.2896, GNorm = 2.1458, lr_0 = 9.9696e-04
Validation auc = 0.666705
Epoch 4634
Loss = 2.9227e-02, PNorm = 626.3283, GNorm = 2.5717, lr_0 = 9.9696e-04
Validation auc = 0.664522
Epoch 4635
Loss = 2.7504e-02, PNorm = 626.3610, GNorm = 1.0849, lr_0 = 9.9695e-04
Validation auc = 0.670562
Epoch 4636
Loss = 1.2789e-02, PNorm = 626.3899, GNorm = 0.8901, lr_0 = 9.9695e-04
Validation auc = 0.671367
Epoch 4637
Loss = 1.4321e-02, PNorm = 626.4220, GNorm = 1.3054, lr_0 = 9.9695e-04
Validation auc = 0.667327
Epoch 4638
Loss = 1.7587e-02, PNorm = 626.4817, GNorm = 1.8778, lr_0 = 9.9695e-04
Validation auc = 0.657528
Epoch 4639
Loss = 7.3251e-03, PNorm = 626.5454, GNorm = 0.4614, lr_0 = 9.9695e-04
Loss = 1.0450e-01, PNorm = 626.6210, GNorm = 3.1067, lr_0 = 9.9695e-04
Validation auc = 0.656612
Epoch 4640
Loss = 5.6463e-02, PNorm = 626.6972, GNorm = 1.2302, lr_0 = 9.9695e-04
Validation auc = 0.660924
Epoch 4641
Loss = 5.4505e-02, PNorm = 626.7653, GNorm = 1.0219, lr_0 = 9.9695e-04
Validation auc = 0.662120
Epoch 4642
Loss = 4.1845e-02, PNorm = 626.8372, GNorm = 1.0368, lr_0 = 9.9695e-04
Validation auc = 0.665009
Epoch 4643
Loss = 6.0572e-02, PNorm = 626.9040, GNorm = 2.2462, lr_0 = 9.9695e-04
Validation auc = 0.668347
Epoch 4644
Loss = 7.2662e-02, PNorm = 626.9747, GNorm = 0.6696, lr_0 = 9.9695e-04
Validation auc = 0.669186
Epoch 4645
Loss = 5.2577e-02, PNorm = 627.0337, GNorm = 4.8945, lr_0 = 9.9695e-04
Validation auc = 0.669781
Epoch 4646
Loss = 3.9584e-02, PNorm = 627.0873, GNorm = 1.3623, lr_0 = 9.9695e-04
Validation auc = 0.674366
Epoch 4647
Loss = 8.4543e-02, PNorm = 627.1453, GNorm = 0.9453, lr_0 = 9.9695e-04
Validation auc = 0.672289
Epoch 4648
Loss = 2.8409e-02, PNorm = 627.2139, GNorm = 1.2053, lr_0 = 9.9694e-04
Validation auc = 0.672408
Epoch 4649
Loss = 1.0629e-02, PNorm = 627.2701, GNorm = 0.4637, lr_0 = 9.9694e-04
Loss = 1.0673e-01, PNorm = 627.3520, GNorm = 2.1054, lr_0 = 9.9694e-04
Validation auc = 0.674085
Epoch 4650
Loss = 3.4643e-02, PNorm = 627.4444, GNorm = 1.4333, lr_0 = 9.9694e-04
Validation auc = 0.671835
Epoch 4651
Loss = 1.6089e-01, PNorm = 627.5177, GNorm = 15.0538, lr_0 = 9.9694e-04
Validation auc = 0.683290
Epoch 4652
Loss = 5.0310e-02, PNorm = 627.5947, GNorm = 8.0002, lr_0 = 9.9694e-04
Validation auc = 0.691528
Epoch 4653
Loss = 7.6920e-02, PNorm = 627.6917, GNorm = 0.7870, lr_0 = 9.9694e-04
Validation auc = 0.684220
Epoch 4654
Loss = 5.5509e-02, PNorm = 627.7870, GNorm = 0.9804, lr_0 = 9.9694e-04
Validation auc = 0.689209
Epoch 4655
Loss = 4.6838e-02, PNorm = 627.8734, GNorm = 2.6075, lr_0 = 9.9694e-04
Validation auc = 0.693461
Epoch 4656
Loss = 4.6025e-02, PNorm = 627.9402, GNorm = 1.2367, lr_0 = 9.9694e-04
Validation auc = 0.691873
Epoch 4657
Loss = 7.3117e-02, PNorm = 627.9901, GNorm = 1.6984, lr_0 = 9.9694e-04
Validation auc = 0.698093
Epoch 4658
Loss = 5.0498e-02, PNorm = 628.0472, GNorm = 0.0915, lr_0 = 9.9694e-04
Validation auc = 0.706141
Epoch 4659
Loss = 5.2431e-03, PNorm = 628.1119, GNorm = 0.2590, lr_0 = 9.9694e-04
Loss = 7.1391e-02, PNorm = 628.1836, GNorm = 0.1303, lr_0 = 9.9694e-04
Validation auc = 0.704077
Epoch 4660
Loss = 1.1408e-01, PNorm = 628.2464, GNorm = 2.4588, lr_0 = 9.9694e-04
Validation auc = 0.707237
Epoch 4661
Loss = 4.1582e-02, PNorm = 628.3102, GNorm = 1.2234, lr_0 = 9.9693e-04
Validation auc = 0.710582
Epoch 4662
Loss = 8.2188e-02, PNorm = 628.3643, GNorm = 0.1722, lr_0 = 9.9693e-04
Validation auc = 0.700502
Epoch 4663
Loss = 6.6595e-02, PNorm = 628.4403, GNorm = 2.1421, lr_0 = 9.9693e-04
Validation auc = 0.703345
Epoch 4664
Loss = 7.6741e-02, PNorm = 628.5163, GNorm = 3.1927, lr_0 = 9.9693e-04
Validation auc = 0.704980
Epoch 4665
Loss = 6.0556e-02, PNorm = 628.5930, GNorm = 5.3045, lr_0 = 9.9693e-04
Validation auc = 0.694976
Epoch 4666
Loss = 2.6532e-02, PNorm = 628.6713, GNorm = 2.0834, lr_0 = 9.9693e-04
Validation auc = 0.690971
Epoch 4667
Loss = 4.1123e-02, PNorm = 628.7318, GNorm = 0.1335, lr_0 = 9.9693e-04
Validation auc = 0.695396
Epoch 4668
Loss = 5.9723e-02, PNorm = 628.7832, GNorm = 1.7400, lr_0 = 9.9693e-04
Validation auc = 0.693845
Epoch 4669
Loss = 2.0607e-02, PNorm = 628.8448, GNorm = 2.3701, lr_0 = 9.9693e-04
Loss = 8.4280e-02, PNorm = 628.9199, GNorm = 7.8589, lr_0 = 9.9693e-04
Validation auc = 0.703385
Epoch 4670
Loss = 5.0783e-02, PNorm = 628.9997, GNorm = 1.9760, lr_0 = 9.9693e-04
Validation auc = 0.713301
Epoch 4671
Loss = 3.7312e-02, PNorm = 629.0671, GNorm = 1.6931, lr_0 = 9.9693e-04
Validation auc = 0.703063
Epoch 4672
Loss = 1.4171e-01, PNorm = 629.1275, GNorm = 0.1576, lr_0 = 9.9693e-04
Validation auc = 0.704340
Epoch 4673
Loss = 5.9673e-02, PNorm = 629.1983, GNorm = 0.8003, lr_0 = 9.9693e-04
Validation auc = 0.704214
Epoch 4674
Loss = 7.0573e-02, PNorm = 629.2555, GNorm = 1.1051, lr_0 = 9.9692e-04
Validation auc = 0.710540
Epoch 4675
Loss = 2.0724e-02, PNorm = 629.3120, GNorm = 0.3074, lr_0 = 9.9692e-04
Validation auc = 0.711435
Epoch 4676
Loss = 4.0658e-02, PNorm = 629.3652, GNorm = 0.4146, lr_0 = 9.9692e-04
Validation auc = 0.707198
Epoch 4677
Loss = 1.5920e-02, PNorm = 629.4048, GNorm = 0.1005, lr_0 = 9.9692e-04
Validation auc = 0.706863
Epoch 4678
Loss = 1.1680e-01, PNorm = 629.4414, GNorm = 1.1880, lr_0 = 9.9692e-04
Validation auc = 0.706944
Epoch 4679
Loss = 4.6485e-03, PNorm = 629.4822, GNorm = 0.4631, lr_0 = 9.9692e-04
Loss = 6.0570e-02, PNorm = 629.5283, GNorm = 1.5134, lr_0 = 9.9692e-04
Validation auc = 0.719689
Epoch 4680
Loss = 2.7272e-02, PNorm = 629.5937, GNorm = 1.3960, lr_0 = 9.9692e-04
Validation auc = 0.725738
Epoch 4681
Loss = 7.3916e-02, PNorm = 629.6559, GNorm = 0.6208, lr_0 = 9.9692e-04
Validation auc = 0.713420
Epoch 4682
Loss = 6.4364e-02, PNorm = 629.7197, GNorm = 0.2618, lr_0 = 9.9692e-04
Validation auc = 0.694775
Epoch 4683
Loss = 3.1106e-02, PNorm = 629.7788, GNorm = 0.3172, lr_0 = 9.9692e-04
Validation auc = 0.686328
Epoch 4684
Loss = 4.4735e-02, PNorm = 629.8289, GNorm = 1.5462, lr_0 = 9.9692e-04
Validation auc = 0.685389
Epoch 4685
Loss = 7.0861e-02, PNorm = 629.8957, GNorm = 3.8136, lr_0 = 9.9692e-04
Validation auc = 0.691075
Epoch 4686
Loss = 2.0919e-02, PNorm = 629.9791, GNorm = 2.3557, lr_0 = 9.9692e-04
Validation auc = 0.694636
Epoch 4687
Loss = 5.2854e-02, PNorm = 630.0329, GNorm = 0.2671, lr_0 = 9.9692e-04
Validation auc = 0.693822
Epoch 4688
Loss = 5.0186e-02, PNorm = 630.0887, GNorm = 2.8349, lr_0 = 9.9691e-04
Validation auc = 0.694141
Epoch 4689
Loss = 9.6785e-03, PNorm = 630.1482, GNorm = 0.5925, lr_0 = 9.9691e-04
Loss = 5.3331e-02, PNorm = 630.2218, GNorm = 0.1701, lr_0 = 9.9691e-04
Validation auc = 0.699082
Epoch 4690
Loss = 7.7917e-02, PNorm = 630.2935, GNorm = 1.4658, lr_0 = 9.9691e-04
Validation auc = 0.708686
Epoch 4691
Loss = 4.4388e-02, PNorm = 630.3490, GNorm = 1.3764, lr_0 = 9.9691e-04
Validation auc = 0.713922
Epoch 4692
Loss = 3.7736e-02, PNorm = 630.3969, GNorm = 2.0398, lr_0 = 9.9691e-04
Validation auc = 0.717202
Epoch 4693
Loss = 4.6460e-02, PNorm = 630.4399, GNorm = 0.3340, lr_0 = 9.9691e-04
Validation auc = 0.717563
Epoch 4694
Loss = 5.4478e-02, PNorm = 630.4910, GNorm = 0.7673, lr_0 = 9.9691e-04
Validation auc = 0.707258
Epoch 4695
Loss = 4.5271e-02, PNorm = 630.5380, GNorm = 2.8245, lr_0 = 9.9691e-04
Validation auc = 0.700352
Epoch 4696
Loss = 7.3597e-02, PNorm = 630.5878, GNorm = 1.1806, lr_0 = 9.9691e-04
Validation auc = 0.700378
Epoch 4697
Loss = 1.1692e-01, PNorm = 630.6512, GNorm = 1.1239, lr_0 = 9.9691e-04
Validation auc = 0.702568
Epoch 4698
Loss = 4.4437e-02, PNorm = 630.7134, GNorm = 3.0958, lr_0 = 9.9691e-04
Validation auc = 0.701599
Epoch 4699
Loss = 2.9942e-02, PNorm = 630.7917, GNorm = 1.4893, lr_0 = 9.9691e-04
Loss = 9.1378e-02, PNorm = 630.8683, GNorm = 1.9058, lr_0 = 9.9691e-04
Validation auc = 0.692094
Epoch 4700
Loss = 5.6436e-02, PNorm = 630.9490, GNorm = 0.9718, lr_0 = 9.9691e-04
Validation auc = 0.687111
Epoch 4701
Loss = 5.7691e-02, PNorm = 631.0162, GNorm = 1.1037, lr_0 = 9.9690e-04
Validation auc = 0.683410
Epoch 4702
Loss = 1.6842e-02, PNorm = 631.0719, GNorm = 0.1072, lr_0 = 9.9690e-04
Validation auc = 0.685830
Epoch 4703
Loss = 4.1144e-02, PNorm = 631.1125, GNorm = 1.5536, lr_0 = 9.9690e-04
Validation auc = 0.687507
Epoch 4704
Loss = 3.8502e-02, PNorm = 631.1468, GNorm = 0.2199, lr_0 = 9.9690e-04
Validation auc = 0.690110
Epoch 4705
Loss = 1.7329e-02, PNorm = 631.1835, GNorm = 4.5087, lr_0 = 9.9690e-04
Validation auc = 0.693824
Epoch 4706
Loss = 1.5223e-02, PNorm = 631.2211, GNorm = 0.3652, lr_0 = 9.9690e-04
Validation auc = 0.693042
Epoch 4707
Loss = 8.7420e-03, PNorm = 631.2587, GNorm = 0.8010, lr_0 = 9.9690e-04
Validation auc = 0.695577
Epoch 4708
Loss = 8.5667e-03, PNorm = 631.3046, GNorm = 0.8347, lr_0 = 9.9690e-04
Validation auc = 0.701940
Epoch 4709
Loss = 5.5779e-03, PNorm = 631.3608, GNorm = 0.3412, lr_0 = 9.9690e-04
Loss = 3.9924e-02, PNorm = 631.4323, GNorm = 0.2331, lr_0 = 9.9690e-04
Validation auc = 0.713131
Epoch 4710
Loss = 6.3998e-02, PNorm = 631.5148, GNorm = 3.0623, lr_0 = 9.9690e-04
Validation auc = 0.719575
Epoch 4711
Loss = 9.4131e-02, PNorm = 631.5835, GNorm = 2.7573, lr_0 = 9.9690e-04
Validation auc = 0.717138
Epoch 4712
Loss = 2.7661e-02, PNorm = 631.6563, GNorm = 2.7646, lr_0 = 9.9690e-04
Validation auc = 0.710561
Epoch 4713
Loss = 1.0117e-01, PNorm = 631.7310, GNorm = 0.6816, lr_0 = 9.9690e-04
Validation auc = 0.712698
Epoch 4714
Loss = 3.0220e-02, PNorm = 631.8069, GNorm = 0.2270, lr_0 = 9.9689e-04
Validation auc = 0.712647
Epoch 4715
Loss = 5.9812e-02, PNorm = 631.8638, GNorm = 1.8462, lr_0 = 9.9689e-04
Validation auc = 0.704010
Epoch 4716
Loss = 1.7659e-02, PNorm = 631.9214, GNorm = 0.5408, lr_0 = 9.9689e-04
Validation auc = 0.700114
Epoch 4717
Loss = 1.2677e-01, PNorm = 631.9780, GNorm = 0.8475, lr_0 = 9.9689e-04
Validation auc = 0.700974
Epoch 4718
Loss = 2.7786e-03, PNorm = 632.0420, GNorm = 0.1440, lr_0 = 9.9689e-04
Validation auc = 0.702977
Epoch 4719
Loss = 8.8767e-03, PNorm = 632.0882, GNorm = 0.8584, lr_0 = 9.9689e-04
Loss = 6.9502e-02, PNorm = 632.1233, GNorm = 9.5191, lr_0 = 9.9689e-04
Validation auc = 0.694105
Epoch 4720
Loss = 2.9402e-02, PNorm = 632.1728, GNorm = 0.6913, lr_0 = 9.9689e-04
Validation auc = 0.682155
Epoch 4721
Loss = 2.0850e-02, PNorm = 632.2188, GNorm = 1.3627, lr_0 = 9.9689e-04
Validation auc = 0.676550
Epoch 4722
Loss = 3.5058e-02, PNorm = 632.2521, GNorm = 6.3769, lr_0 = 9.9689e-04
Validation auc = 0.672512
Epoch 4723
Loss = 3.0460e-02, PNorm = 632.2851, GNorm = 0.8403, lr_0 = 9.9689e-04
Validation auc = 0.668855
Epoch 4724
Loss = 1.3740e-02, PNorm = 632.3179, GNorm = 0.2912, lr_0 = 9.9689e-04
Validation auc = 0.667707
Epoch 4725
Loss = 2.4822e-02, PNorm = 632.3437, GNorm = 2.0715, lr_0 = 9.9689e-04
Validation auc = 0.670011
Epoch 4726
Loss = 1.6389e-02, PNorm = 632.3666, GNorm = 0.5263, lr_0 = 9.9689e-04
Validation auc = 0.672898
Epoch 4727
Loss = 2.5857e-02, PNorm = 632.3907, GNorm = 0.6398, lr_0 = 9.9689e-04
Validation auc = 0.672197
Epoch 4728
Loss = 2.3939e-02, PNorm = 632.4255, GNorm = 0.0548, lr_0 = 9.9688e-04
Validation auc = 0.670787
Epoch 4729
Loss = 6.7301e-02, PNorm = 632.4659, GNorm = 1.7934, lr_0 = 9.9688e-04
Loss = 7.7349e-02, PNorm = 632.4948, GNorm = 1.3315, lr_0 = 9.9688e-04
Validation auc = 0.670780
Epoch 4730
Loss = 4.2241e-02, PNorm = 632.5289, GNorm = 6.4611, lr_0 = 9.9688e-04
Validation auc = 0.677878
Epoch 4731
Loss = 8.6776e-02, PNorm = 632.5759, GNorm = 1.1919, lr_0 = 9.9688e-04
Validation auc = 0.691598
Epoch 4732
Loss = 8.8811e-02, PNorm = 632.6332, GNorm = 2.5396, lr_0 = 9.9688e-04
Validation auc = 0.694678
Epoch 4733
Loss = 2.7798e-02, PNorm = 632.6767, GNorm = 12.9986, lr_0 = 9.9688e-04
Validation auc = 0.695985
Epoch 4734
Loss = 5.5091e-02, PNorm = 632.7255, GNorm = 2.3391, lr_0 = 9.9688e-04
Validation auc = 0.699304
Epoch 4735
Loss = 6.5652e-02, PNorm = 632.7820, GNorm = 1.4528, lr_0 = 9.9688e-04
Validation auc = 0.691737
Epoch 4736
Loss = 1.3003e-01, PNorm = 632.8479, GNorm = 1.2672, lr_0 = 9.9688e-04
Validation auc = 0.684685
Epoch 4737
Loss = 3.7508e-02, PNorm = 632.9192, GNorm = 0.8242, lr_0 = 9.9688e-04
Validation auc = 0.681885
Epoch 4738
Loss = 2.0226e-02, PNorm = 632.9824, GNorm = 1.2215, lr_0 = 9.9688e-04
Validation auc = 0.689031
Epoch 4739
Loss = 3.2590e-01, PNorm = 633.0451, GNorm = 4.8775, lr_0 = 9.9688e-04
Loss = 5.1847e-02, PNorm = 633.1147, GNorm = 1.5742, lr_0 = 9.9688e-04
Validation auc = 0.698265
Epoch 4740
Loss = 2.2632e-02, PNorm = 633.1724, GNorm = 0.1247, lr_0 = 9.9687e-04
Validation auc = 0.704909
Epoch 4741
Loss = 5.9319e-02, PNorm = 633.2202, GNorm = 0.2251, lr_0 = 9.9687e-04
Validation auc = 0.707099
Epoch 4742
Loss = 4.3539e-02, PNorm = 633.2689, GNorm = 5.4906, lr_0 = 9.9687e-04
Validation auc = 0.705077
Epoch 4743
Loss = 4.1230e-02, PNorm = 633.3211, GNorm = 0.4086, lr_0 = 9.9687e-04
Validation auc = 0.698869
Epoch 4744
Loss = 1.6890e-02, PNorm = 633.3769, GNorm = 0.5199, lr_0 = 9.9687e-04
Validation auc = 0.693958
Epoch 4745
Loss = 1.6509e-02, PNorm = 633.4312, GNorm = 2.5895, lr_0 = 9.9687e-04
Validation auc = 0.685705
Epoch 4746
Loss = 1.1140e-01, PNorm = 633.4846, GNorm = 0.3188, lr_0 = 9.9687e-04
Validation auc = 0.680285
Epoch 4747
Loss = 4.4744e-02, PNorm = 633.5386, GNorm = 1.1233, lr_0 = 9.9687e-04
Validation auc = 0.680930
Epoch 4748
Loss = 7.4141e-02, PNorm = 633.5850, GNorm = 2.1011, lr_0 = 9.9687e-04
Validation auc = 0.692031
Epoch 4749
Loss = 7.0380e-02, PNorm = 633.6426, GNorm = 3.8605, lr_0 = 9.9687e-04
Loss = 4.4836e-02, PNorm = 633.6898, GNorm = 3.2372, lr_0 = 9.9687e-04
Validation auc = 0.699080
Epoch 4750
Loss = 3.8771e-02, PNorm = 633.7322, GNorm = 0.9111, lr_0 = 9.9687e-04
Validation auc = 0.706217
Epoch 4751
Loss = 6.3313e-02, PNorm = 633.7798, GNorm = 5.3618, lr_0 = 9.9687e-04
Validation auc = 0.708254
Epoch 4752
Loss = 8.5071e-02, PNorm = 633.8326, GNorm = 1.0082, lr_0 = 9.9687e-04
Validation auc = 0.702890
Epoch 4753
Loss = 1.0996e-01, PNorm = 633.8939, GNorm = 8.3907, lr_0 = 9.9687e-04
Validation auc = 0.703642
Epoch 4754
Loss = 9.1707e-02, PNorm = 633.9592, GNorm = 1.0689, lr_0 = 9.9686e-04
Validation auc = 0.703233
Epoch 4755
Loss = 2.9674e-02, PNorm = 634.0157, GNorm = 0.4882, lr_0 = 9.9686e-04
Validation auc = 0.704652
Epoch 4756
Loss = 5.8087e-02, PNorm = 634.0527, GNorm = 2.7907, lr_0 = 9.9686e-04
Validation auc = 0.703007
Epoch 4757
Loss = 3.0103e-02, PNorm = 634.0846, GNorm = 2.5711, lr_0 = 9.9686e-04
Validation auc = 0.701806
Epoch 4758
Loss = 6.0673e-02, PNorm = 634.1291, GNorm = 0.4747, lr_0 = 9.9686e-04
Validation auc = 0.696991
Epoch 4759
Loss = 4.9890e-02, PNorm = 634.1894, GNorm = 1.5521, lr_0 = 9.9686e-04
Loss = 4.7506e-02, PNorm = 634.2435, GNorm = 0.3093, lr_0 = 9.9686e-04
Validation auc = 0.691982
Epoch 4760
Loss = 8.8389e-02, PNorm = 634.3005, GNorm = 6.7918, lr_0 = 9.9686e-04
Validation auc = 0.691358
Epoch 4761
Loss = 3.0210e-02, PNorm = 634.3576, GNorm = 1.7413, lr_0 = 9.9686e-04
Validation auc = 0.692397
Epoch 4762
Loss = 6.1689e-02, PNorm = 634.4139, GNorm = 1.2550, lr_0 = 9.9686e-04
Validation auc = 0.700196
Epoch 4763
Loss = 5.1954e-02, PNorm = 634.4730, GNorm = 0.2011, lr_0 = 9.9686e-04
Validation auc = 0.701857
Epoch 4764
Loss = 6.9441e-02, PNorm = 634.5230, GNorm = 2.0184, lr_0 = 9.9686e-04
Validation auc = 0.699635
Epoch 4765
Loss = 4.4340e-02, PNorm = 634.5821, GNorm = 3.6827, lr_0 = 9.9686e-04
Validation auc = 0.700857
Epoch 4766
Loss = 5.4230e-02, PNorm = 634.6342, GNorm = 1.9561, lr_0 = 9.9686e-04
Validation auc = 0.707572
Epoch 4767
Loss = 1.7070e-02, PNorm = 634.7024, GNorm = 0.2757, lr_0 = 9.9685e-04
Validation auc = 0.706605
Epoch 4768
Loss = 4.0043e-02, PNorm = 634.7683, GNorm = 2.7667, lr_0 = 9.9685e-04
Validation auc = 0.708518
Epoch 4769
Loss = 4.6718e-02, PNorm = 634.8552, GNorm = 2.1971, lr_0 = 9.9685e-04
Loss = 8.8501e-02, PNorm = 634.9444, GNorm = 0.9816, lr_0 = 9.9685e-04
Validation auc = 0.701120
Epoch 4770
Loss = 1.2192e-01, PNorm = 635.0240, GNorm = 1.8833, lr_0 = 9.9685e-04
Validation auc = 0.687254
Epoch 4771
Loss = 6.1832e-02, PNorm = 635.0982, GNorm = 2.1461, lr_0 = 9.9685e-04
Validation auc = 0.692054
Epoch 4772
Loss = 5.1578e-02, PNorm = 635.1619, GNorm = 3.4930, lr_0 = 9.9685e-04
Validation auc = 0.696304
Epoch 4773
Loss = 7.2813e-02, PNorm = 635.2223, GNorm = 2.8436, lr_0 = 9.9685e-04
Validation auc = 0.700699
Epoch 4774
Loss = 5.3182e-02, PNorm = 635.2823, GNorm = 3.0565, lr_0 = 9.9685e-04
Validation auc = 0.709862
Epoch 4775
Loss = 8.8185e-02, PNorm = 635.3706, GNorm = 4.3230, lr_0 = 9.9685e-04
Validation auc = 0.729391
Epoch 4776
Loss = 3.9802e-02, PNorm = 635.4673, GNorm = 2.1346, lr_0 = 9.9685e-04
Validation auc = 0.731806
Epoch 4777
Loss = 4.7825e-02, PNorm = 635.5365, GNorm = 0.9006, lr_0 = 9.9685e-04
Validation auc = 0.727333
Epoch 4778
Loss = 1.5307e-02, PNorm = 635.5866, GNorm = 1.1117, lr_0 = 9.9685e-04
Validation auc = 0.719120
Epoch 4779
Loss = 1.0398e-01, PNorm = 635.6431, GNorm = 3.1209, lr_0 = 9.9685e-04
Loss = 3.6549e-02, PNorm = 635.7020, GNorm = 1.1780, lr_0 = 9.9685e-04
Validation auc = 0.721417
Epoch 4780
Loss = 4.6647e-02, PNorm = 635.7494, GNorm = 2.2490, lr_0 = 9.9684e-04
Validation auc = 0.726511
Epoch 4781
Loss = 5.5207e-02, PNorm = 635.8045, GNorm = 4.6736, lr_0 = 9.9684e-04
Validation auc = 0.726786
Epoch 4782
Loss = 2.2523e-02, PNorm = 635.8581, GNorm = 1.2682, lr_0 = 9.9684e-04
Validation auc = 0.734303
Epoch 4783
Loss = 4.5790e-02, PNorm = 635.9077, GNorm = 3.1042, lr_0 = 9.9684e-04
Validation auc = 0.732525
Epoch 4784
Loss = 2.9068e-02, PNorm = 635.9605, GNorm = 1.7906, lr_0 = 9.9684e-04
Validation auc = 0.723113
Epoch 4785
Loss = 3.8276e-02, PNorm = 636.0158, GNorm = 0.5604, lr_0 = 9.9684e-04
Validation auc = 0.719657
Epoch 4786
Loss = 1.0677e-01, PNorm = 636.0664, GNorm = 7.8007, lr_0 = 9.9684e-04
Validation auc = 0.713717
Epoch 4787
Loss = 5.6920e-02, PNorm = 636.1388, GNorm = 0.7814, lr_0 = 9.9684e-04
Validation auc = 0.715467
Epoch 4788
Loss = 2.9735e-02, PNorm = 636.2151, GNorm = 0.3940, lr_0 = 9.9684e-04
Validation auc = 0.715173
Epoch 4789
Loss = 1.7617e-02, PNorm = 636.2769, GNorm = 0.5990, lr_0 = 9.9684e-04
Loss = 5.6468e-02, PNorm = 636.3319, GNorm = 2.4985, lr_0 = 9.9684e-04
Validation auc = 0.706325
Epoch 4790
Loss = 6.1710e-02, PNorm = 636.3896, GNorm = 1.3210, lr_0 = 9.9684e-04
Validation auc = 0.691086
Epoch 4791
Loss = 4.5965e-02, PNorm = 636.4451, GNorm = 1.3095, lr_0 = 9.9684e-04
Validation auc = 0.684476
Epoch 4792
Loss = 2.3656e-02, PNorm = 636.4872, GNorm = 0.2708, lr_0 = 9.9684e-04
Validation auc = 0.680952
Epoch 4793
Loss = 3.0976e-02, PNorm = 636.5230, GNorm = 0.2097, lr_0 = 9.9684e-04
Validation auc = 0.679837
Epoch 4794
Loss = 4.9574e-02, PNorm = 636.5572, GNorm = 1.2575, lr_0 = 9.9683e-04
Validation auc = 0.683463
Epoch 4795
Loss = 1.2681e-01, PNorm = 636.5953, GNorm = 0.1830, lr_0 = 9.9683e-04
Validation auc = 0.675652
Epoch 4796
Loss = 1.5750e-01, PNorm = 636.6312, GNorm = 1.0868, lr_0 = 9.9683e-04
Validation auc = 0.668023
Epoch 4797
Loss = 2.6462e-02, PNorm = 636.6879, GNorm = 0.3238, lr_0 = 9.9683e-04
Validation auc = 0.653404
Epoch 4798
Loss = 5.6619e-02, PNorm = 636.7596, GNorm = 0.7396, lr_0 = 9.9683e-04
Validation auc = 0.667901
Epoch 4799
Loss = 6.7222e-02, PNorm = 636.8217, GNorm = 2.0374, lr_0 = 9.9683e-04
Loss = 1.1571e-01, PNorm = 636.8792, GNorm = 3.7504, lr_0 = 9.9683e-04
Validation auc = 0.688824
Epoch 4800
Loss = 8.7090e-02, PNorm = 636.9427, GNorm = 4.6942, lr_0 = 9.9683e-04
Validation auc = 0.697759
Epoch 4801
Loss = 5.7409e-02, PNorm = 637.0052, GNorm = 3.6147, lr_0 = 9.9683e-04
Validation auc = 0.694454
Epoch 4802
Loss = 3.1253e-02, PNorm = 637.0624, GNorm = 0.7788, lr_0 = 9.9683e-04
Validation auc = 0.693874
Epoch 4803
Loss = 1.3875e-01, PNorm = 637.1180, GNorm = 2.2463, lr_0 = 9.9683e-04
Validation auc = 0.690533
Epoch 4804
Loss = 5.1225e-02, PNorm = 637.1897, GNorm = 0.8283, lr_0 = 9.9683e-04
Validation auc = 0.691728
Epoch 4805
Loss = 3.7911e-02, PNorm = 637.2618, GNorm = 0.9503, lr_0 = 9.9683e-04
Validation auc = 0.698290
Epoch 4806
Loss = 3.7282e-02, PNorm = 637.3235, GNorm = 0.8933, lr_0 = 9.9683e-04
Validation auc = 0.709543
Epoch 4807
Loss = 2.9630e-01, PNorm = 637.3717, GNorm = 7.2705, lr_0 = 9.9682e-04
Validation auc = 0.703937
Epoch 4808
Loss = 9.0446e-02, PNorm = 637.4217, GNorm = 3.6939, lr_0 = 9.9682e-04
Validation auc = 0.696645
Epoch 4809
Loss = 2.2990e-02, PNorm = 637.4714, GNorm = 1.5452, lr_0 = 9.9682e-04
Loss = 7.3732e-02, PNorm = 637.5329, GNorm = 1.2242, lr_0 = 9.9682e-04
Validation auc = 0.697188
Epoch 4810
Loss = 3.5624e-02, PNorm = 637.5913, GNorm = 1.9518, lr_0 = 9.9682e-04
Validation auc = 0.701512
Epoch 4811
Loss = 1.7333e-02, PNorm = 637.6414, GNorm = 0.6068, lr_0 = 9.9682e-04
Validation auc = 0.706381
Epoch 4812
Loss = 1.6633e-02, PNorm = 637.6833, GNorm = 1.0969, lr_0 = 9.9682e-04
Validation auc = 0.706605
Epoch 4813
Loss = 3.4190e-02, PNorm = 637.7210, GNorm = 0.4901, lr_0 = 9.9682e-04
Validation auc = 0.711094
Epoch 4814
Loss = 3.7901e-02, PNorm = 637.7607, GNorm = 0.2445, lr_0 = 9.9682e-04
Validation auc = 0.713957
Epoch 4815
Loss = 6.5044e-02, PNorm = 637.8006, GNorm = 2.1596, lr_0 = 9.9682e-04
Validation auc = 0.718255
Epoch 4816
Loss = 9.0578e-03, PNorm = 637.8441, GNorm = 0.7130, lr_0 = 9.9682e-04
Validation auc = 0.720770
Epoch 4817
Loss = 8.3231e-02, PNorm = 637.8860, GNorm = 0.2449, lr_0 = 9.9682e-04
Validation auc = 0.714633
Epoch 4818
Loss = 3.6546e-02, PNorm = 637.9342, GNorm = 2.0922, lr_0 = 9.9682e-04
Validation auc = 0.711556
Epoch 4819
Loss = 2.3718e-03, PNorm = 637.9746, GNorm = 0.1270, lr_0 = 9.9682e-04
Loss = 4.5507e-02, PNorm = 638.0128, GNorm = 4.2714, lr_0 = 9.9682e-04
Validation auc = 0.715555
Epoch 4820
Loss = 7.1469e-02, PNorm = 638.0636, GNorm = 1.5689, lr_0 = 9.9681e-04
Validation auc = 0.715457
Epoch 4821
Loss = 4.8323e-02, PNorm = 638.1164, GNorm = 0.2975, lr_0 = 9.9681e-04
Validation auc = 0.716307
Epoch 4822
Loss = 2.4077e-02, PNorm = 638.1690, GNorm = 0.8384, lr_0 = 9.9681e-04
Validation auc = 0.712348
Epoch 4823
Loss = 4.5283e-02, PNorm = 638.2115, GNorm = 3.8647, lr_0 = 9.9681e-04
Validation auc = 0.709918
Epoch 4824
Loss = 1.2312e-01, PNorm = 638.2556, GNorm = 0.3872, lr_0 = 9.9681e-04
Validation auc = 0.708953
Epoch 4825
Loss = 3.4555e-02, PNorm = 638.3011, GNorm = 0.2978, lr_0 = 9.9681e-04
Validation auc = 0.707505
Epoch 4826
Loss = 1.4645e-01, PNorm = 638.3553, GNorm = 3.1117, lr_0 = 9.9681e-04
Validation auc = 0.704399
Epoch 4827
Loss = 1.3391e-02, PNorm = 638.4282, GNorm = 1.3313, lr_0 = 9.9681e-04
Validation auc = 0.702354
Epoch 4828
Loss = 3.1116e-01, PNorm = 638.4841, GNorm = 7.9058, lr_0 = 9.9681e-04
Validation auc = 0.704880
Epoch 4829
Loss = 1.3885e-01, PNorm = 638.5569, GNorm = 4.1078, lr_0 = 9.9681e-04
Loss = 4.8659e-02, PNorm = 638.6240, GNorm = 1.4870, lr_0 = 9.9681e-04
Validation auc = 0.699342
Epoch 4830
Loss = 3.6310e-02, PNorm = 638.6748, GNorm = 2.5372, lr_0 = 9.9681e-04
Validation auc = 0.694779
Epoch 4831
Loss = 1.2939e-02, PNorm = 638.7208, GNorm = 0.3667, lr_0 = 9.9681e-04
Validation auc = 0.693854
Epoch 4832
Loss = 7.6526e-02, PNorm = 638.7807, GNorm = 4.5889, lr_0 = 9.9681e-04
Validation auc = 0.713306
Epoch 4833
Loss = 5.8656e-02, PNorm = 638.8535, GNorm = 1.9319, lr_0 = 9.9680e-04
Validation auc = 0.712092
Epoch 4834
Loss = 1.8720e-01, PNorm = 638.9205, GNorm = 5.3663, lr_0 = 9.9680e-04
Validation auc = 0.709108
Epoch 4835
Loss = 5.4238e-02, PNorm = 638.9946, GNorm = 1.9148, lr_0 = 9.9680e-04
Validation auc = 0.699324
Epoch 4836
Loss = 7.9634e-02, PNorm = 639.0674, GNorm = 1.5771, lr_0 = 9.9680e-04
Validation auc = 0.699282
Epoch 4837
Loss = 9.0675e-02, PNorm = 639.1293, GNorm = 2.4134, lr_0 = 9.9680e-04
Validation auc = 0.697541
Epoch 4838
Loss = 8.7434e-02, PNorm = 639.1813, GNorm = 0.6878, lr_0 = 9.9680e-04
Validation auc = 0.693748
Epoch 4839
Loss = 9.1716e-02, PNorm = 639.2393, GNorm = 3.9124, lr_0 = 9.9680e-04
Loss = 2.6366e-02, PNorm = 639.2970, GNorm = 0.2576, lr_0 = 9.9680e-04
Validation auc = 0.694843
Epoch 4840
Loss = 6.8555e-02, PNorm = 639.3431, GNorm = 0.5949, lr_0 = 9.9680e-04
Validation auc = 0.689195
Epoch 4841
Loss = 4.2555e-02, PNorm = 639.4015, GNorm = 0.5746, lr_0 = 9.9680e-04
Validation auc = 0.677238
Epoch 4842
Loss = 3.0029e-02, PNorm = 639.4534, GNorm = 0.2314, lr_0 = 9.9680e-04
Validation auc = 0.672110
Epoch 4843
Loss = 3.3654e-02, PNorm = 639.5013, GNorm = 3.6470, lr_0 = 9.9680e-04
Validation auc = 0.675590
Epoch 4844
Loss = 8.3674e-02, PNorm = 639.5474, GNorm = 1.6961, lr_0 = 9.9680e-04
Validation auc = 0.682892
Epoch 4845
Loss = 1.7018e-02, PNorm = 639.6089, GNorm = 0.2189, lr_0 = 9.9680e-04
Validation auc = 0.683406
Epoch 4846
Loss = 5.6747e-02, PNorm = 639.6616, GNorm = 1.9441, lr_0 = 9.9680e-04
Validation auc = 0.685880
Epoch 4847
Loss = 2.9224e-01, PNorm = 639.7108, GNorm = 9.6083, lr_0 = 9.9679e-04
Validation auc = 0.678623
Epoch 4848
Loss = 2.0928e-02, PNorm = 639.7896, GNorm = 1.2394, lr_0 = 9.9679e-04
Validation auc = 0.676899
Epoch 4849
Loss = 6.2322e-02, PNorm = 639.8557, GNorm = 2.6782, lr_0 = 9.9679e-04
Loss = 5.8241e-02, PNorm = 639.9150, GNorm = 4.0228, lr_0 = 9.9679e-04
Validation auc = 0.675945
Epoch 4850
Loss = 4.0718e-02, PNorm = 639.9788, GNorm = 0.2845, lr_0 = 9.9679e-04
Validation auc = 0.679648
Epoch 4851
Loss = 1.0432e-01, PNorm = 640.0222, GNorm = 8.1026, lr_0 = 9.9679e-04
Validation auc = 0.683194
Epoch 4852
Loss = 1.1205e-01, PNorm = 640.0651, GNorm = 0.7379, lr_0 = 9.9679e-04
Validation auc = 0.681521
Epoch 4853
Loss = 5.3159e-02, PNorm = 640.1204, GNorm = 1.9175, lr_0 = 9.9679e-04
Validation auc = 0.678000
Epoch 4854
Loss = 5.7825e-02, PNorm = 640.1695, GNorm = 0.5284, lr_0 = 9.9679e-04
Validation auc = 0.679022
Epoch 4855
Loss = 5.3835e-02, PNorm = 640.2190, GNorm = 1.0878, lr_0 = 9.9679e-04
Validation auc = 0.685735
Epoch 4856
Loss = 8.3623e-02, PNorm = 640.2659, GNorm = 4.3601, lr_0 = 9.9679e-04
Validation auc = 0.683820
Epoch 4857
Loss = 4.3946e-03, PNorm = 640.3176, GNorm = 0.2791, lr_0 = 9.9679e-04
Validation auc = 0.688649
Epoch 4858
Loss = 2.0080e-02, PNorm = 640.3768, GNorm = 0.5404, lr_0 = 9.9679e-04
Validation auc = 0.693877
Epoch 4859
Loss = 2.5767e-01, PNorm = 640.4433, GNorm = 5.6444, lr_0 = 9.9679e-04
Loss = 4.8666e-02, PNorm = 640.5070, GNorm = 8.2919, lr_0 = 9.9678e-04
Validation auc = 0.693692
Epoch 4860
Loss = 1.2473e-01, PNorm = 640.5668, GNorm = 2.9849, lr_0 = 9.9678e-04
Validation auc = 0.697700
Epoch 4861
Loss = 5.1619e-02, PNorm = 640.6410, GNorm = 10.0454, lr_0 = 9.9678e-04
Validation auc = 0.710659
Epoch 4862
Loss = 4.1844e-02, PNorm = 640.7075, GNorm = 0.3207, lr_0 = 9.9678e-04
Validation auc = 0.713303
Epoch 4863
Loss = 4.3826e-02, PNorm = 640.7622, GNorm = 1.0131, lr_0 = 9.9678e-04
Validation auc = 0.703524
Epoch 4864
Loss = 3.8393e-02, PNorm = 640.8388, GNorm = 1.6401, lr_0 = 9.9678e-04
Validation auc = 0.691376
Epoch 4865
Loss = 6.0116e-02, PNorm = 640.9245, GNorm = 1.1959, lr_0 = 9.9678e-04
Validation auc = 0.689658
Epoch 4866
Loss = 1.6332e-01, PNorm = 641.0023, GNorm = 1.6681, lr_0 = 9.9678e-04
Validation auc = 0.685381
Epoch 4867
Loss = 2.0185e-02, PNorm = 641.0808, GNorm = 0.9742, lr_0 = 9.9678e-04
Validation auc = 0.684384
Epoch 4868
Loss = 2.9463e-02, PNorm = 641.1379, GNorm = 0.4937, lr_0 = 9.9678e-04
Validation auc = 0.690400
Epoch 4869
Loss = 1.6001e-03, PNorm = 641.1771, GNorm = 0.1461, lr_0 = 9.9678e-04
Loss = 2.7086e-02, PNorm = 641.2085, GNorm = 1.0091, lr_0 = 9.9678e-04
Validation auc = 0.696639
Epoch 4870
Loss = 2.2668e-02, PNorm = 641.2386, GNorm = 2.2638, lr_0 = 9.9678e-04
Validation auc = 0.701261
Epoch 4871
Loss = 6.5444e-02, PNorm = 641.2754, GNorm = 2.1964, lr_0 = 9.9678e-04
Validation auc = 0.696319
Epoch 4872
Loss = 6.1784e-02, PNorm = 641.3254, GNorm = 1.8856, lr_0 = 9.9678e-04
Validation auc = 0.695120
Epoch 4873
Loss = 7.1898e-02, PNorm = 641.3785, GNorm = 3.3351, lr_0 = 9.9677e-04
Validation auc = 0.691313
Epoch 4874
Loss = 5.0606e-02, PNorm = 641.4352, GNorm = 3.6237, lr_0 = 9.9677e-04
Validation auc = 0.687555
Epoch 4875
Loss = 7.1203e-02, PNorm = 641.4984, GNorm = 2.6200, lr_0 = 9.9677e-04
Validation auc = 0.684260
Epoch 4876
Loss = 8.3392e-02, PNorm = 641.5596, GNorm = 1.1141, lr_0 = 9.9677e-04
Validation auc = 0.687958
Epoch 4877
Loss = 5.7153e-02, PNorm = 641.6174, GNorm = 0.2122, lr_0 = 9.9677e-04
Validation auc = 0.693714
Epoch 4878
Loss = 1.8823e-02, PNorm = 641.6652, GNorm = 0.2029, lr_0 = 9.9677e-04
Validation auc = 0.693491
Epoch 4879
Loss = 1.2930e-02, PNorm = 641.7086, GNorm = 0.5489, lr_0 = 9.9677e-04
Loss = 2.2549e-02, PNorm = 641.7517, GNorm = 1.2867, lr_0 = 9.9677e-04
Validation auc = 0.697983
Epoch 4880
Loss = 8.3887e-02, PNorm = 641.8027, GNorm = 5.3657, lr_0 = 9.9677e-04
Validation auc = 0.706735
Epoch 4881
Loss = 4.2885e-02, PNorm = 641.8607, GNorm = 1.6200, lr_0 = 9.9677e-04
Validation auc = 0.713518
Epoch 4882
Loss = 3.9687e-02, PNorm = 641.9136, GNorm = 0.0595, lr_0 = 9.9677e-04
Validation auc = 0.712458
Epoch 4883
Loss = 3.6213e-02, PNorm = 641.9569, GNorm = 0.2905, lr_0 = 9.9677e-04
Validation auc = 0.708868
Epoch 4884
Loss = 1.7943e-02, PNorm = 641.9914, GNorm = 1.3962, lr_0 = 9.9677e-04
Validation auc = 0.704253
Epoch 4885
Loss = 8.1538e-02, PNorm = 642.0309, GNorm = 8.4572, lr_0 = 9.9677e-04
Validation auc = 0.708308
Epoch 4886
Loss = 4.8874e-02, PNorm = 642.0900, GNorm = 1.9344, lr_0 = 9.9677e-04
Validation auc = 0.710979
Epoch 4887
Loss = 4.5142e-02, PNorm = 642.1447, GNorm = 3.3664, lr_0 = 9.9676e-04
Validation auc = 0.704377
Epoch 4888
Loss = 3.3857e-02, PNorm = 642.1968, GNorm = 1.2892, lr_0 = 9.9676e-04
Validation auc = 0.710285
Epoch 4889
Loss = 6.3039e-03, PNorm = 642.2542, GNorm = 0.4197, lr_0 = 9.9676e-04
Loss = 3.8640e-02, PNorm = 642.3088, GNorm = 2.9881, lr_0 = 9.9676e-04
Validation auc = 0.716130
Epoch 4890
Loss = 2.5312e-02, PNorm = 642.3634, GNorm = 0.1501, lr_0 = 9.9676e-04
Validation auc = 0.707338
Epoch 4891
Loss = 3.9060e-02, PNorm = 642.4157, GNorm = 0.5849, lr_0 = 9.9676e-04
Validation auc = 0.693314
Epoch 4892
Loss = 5.4457e-02, PNorm = 642.4630, GNorm = 0.0185, lr_0 = 9.9676e-04
Validation auc = 0.688473
Epoch 4893
Loss = 3.6514e-02, PNorm = 642.5143, GNorm = 0.3877, lr_0 = 9.9676e-04
Validation auc = 0.684604
Epoch 4894
Loss = 3.2925e-02, PNorm = 642.5581, GNorm = 1.0178, lr_0 = 9.9676e-04
Validation auc = 0.678928
Epoch 4895
Loss = 1.2538e-01, PNorm = 642.6043, GNorm = 2.9394, lr_0 = 9.9676e-04
Validation auc = 0.672800
Epoch 4896
Loss = 1.6679e-02, PNorm = 642.6705, GNorm = 2.6502, lr_0 = 9.9676e-04
Validation auc = 0.667406
Epoch 4897
Loss = 2.4168e-01, PNorm = 642.7295, GNorm = 1.9431, lr_0 = 9.9676e-04
Validation auc = 0.678519
Epoch 4898
Loss = 2.0142e-02, PNorm = 642.7937, GNorm = 1.6015, lr_0 = 9.9676e-04
Validation auc = 0.679843
Epoch 4899
Loss = 9.1823e-03, PNorm = 642.8574, GNorm = 0.5345, lr_0 = 9.9676e-04
Loss = 7.6191e-02, PNorm = 642.9195, GNorm = 1.7393, lr_0 = 9.9675e-04
Validation auc = 0.682319
Epoch 4900
Loss = 1.0257e-01, PNorm = 642.9784, GNorm = 2.3672, lr_0 = 9.9675e-04
Validation auc = 0.676186
Epoch 4901
Loss = 6.8335e-02, PNorm = 643.0417, GNorm = 4.0146, lr_0 = 9.9675e-04
Validation auc = 0.667588
Epoch 4902
Loss = 7.1657e-02, PNorm = 643.0999, GNorm = 0.7274, lr_0 = 9.9675e-04
Validation auc = 0.664848
Epoch 4903
Loss = 5.5279e-02, PNorm = 643.1615, GNorm = 0.9008, lr_0 = 9.9675e-04
Validation auc = 0.668282
Epoch 4904
Loss = 3.9417e-02, PNorm = 643.2156, GNorm = 1.0395, lr_0 = 9.9675e-04
Validation auc = 0.673728
Epoch 4905
Loss = 5.4049e-02, PNorm = 643.2654, GNorm = 2.2706, lr_0 = 9.9675e-04
Validation auc = 0.676876
Epoch 4906
Loss = 4.2424e-02, PNorm = 643.3242, GNorm = 1.3596, lr_0 = 9.9675e-04
Validation auc = 0.676245
Epoch 4907
Loss = 2.6356e-02, PNorm = 643.3801, GNorm = 0.1402, lr_0 = 9.9675e-04
Validation auc = 0.669578
Epoch 4908
Loss = 7.9392e-02, PNorm = 643.4348, GNorm = 0.1388, lr_0 = 9.9675e-04
Validation auc = 0.671848
Epoch 4909
Loss = 2.9197e-03, PNorm = 643.4803, GNorm = 0.1432, lr_0 = 9.9675e-04
Loss = 6.2873e-02, PNorm = 643.5280, GNorm = 5.5736, lr_0 = 9.9675e-04
Validation auc = 0.668746
Epoch 4910
Loss = 4.4127e-02, PNorm = 643.5738, GNorm = 3.9357, lr_0 = 9.9675e-04
Validation auc = 0.667601
Epoch 4911
Loss = 1.0096e-01, PNorm = 643.6218, GNorm = 0.6622, lr_0 = 9.9675e-04
Validation auc = 0.661178
Epoch 4912
Loss = 4.7060e-02, PNorm = 643.6775, GNorm = 0.6164, lr_0 = 9.9675e-04
Validation auc = 0.656444
Epoch 4913
Loss = 2.7678e-02, PNorm = 643.7246, GNorm = 1.3529, lr_0 = 9.9674e-04
Validation auc = 0.652148
Epoch 4914
Loss = 1.4586e-02, PNorm = 643.7607, GNorm = 0.1568, lr_0 = 9.9674e-04
Validation auc = 0.651759
Epoch 4915
Loss = 5.5949e-02, PNorm = 643.7965, GNorm = 8.9977, lr_0 = 9.9674e-04
Validation auc = 0.660947
Epoch 4916
Loss = 2.1847e-02, PNorm = 643.8535, GNorm = 0.3912, lr_0 = 9.9674e-04
Validation auc = 0.665280
Epoch 4917
Loss = 1.1371e-01, PNorm = 643.9049, GNorm = 6.5519, lr_0 = 9.9674e-04
Validation auc = 0.661067
Epoch 4918
Loss = 1.4350e-02, PNorm = 643.9626, GNorm = 0.7484, lr_0 = 9.9674e-04
Validation auc = 0.662853
Epoch 4919
Loss = 8.3328e-04, PNorm = 644.0112, GNorm = 0.1061, lr_0 = 9.9674e-04
Loss = 2.5097e-02, PNorm = 644.0465, GNorm = 4.4291, lr_0 = 9.9674e-04
Validation auc = 0.666510
Epoch 4920
Loss = 1.6863e-02, PNorm = 644.0799, GNorm = 1.9717, lr_0 = 9.9674e-04
Validation auc = 0.662936
Epoch 4921
Loss = 2.8225e-02, PNorm = 644.1103, GNorm = 1.1410, lr_0 = 9.9674e-04
Validation auc = 0.661208
Epoch 4922
Loss = 2.5943e-02, PNorm = 644.1789, GNorm = 0.1778, lr_0 = 9.9674e-04
Validation auc = 0.660252
Epoch 4923
Loss = 1.1949e-01, PNorm = 644.2445, GNorm = 0.1048, lr_0 = 9.9674e-04
Validation auc = 0.671457
Epoch 4924
Loss = 7.5612e-02, PNorm = 644.3080, GNorm = 1.2037, lr_0 = 9.9674e-04
Validation auc = 0.676027
Epoch 4925
Loss = 5.1559e-02, PNorm = 644.3666, GNorm = 1.5525, lr_0 = 9.9674e-04
Validation auc = 0.682564
Epoch 4926
Loss = 1.4798e-01, PNorm = 644.4365, GNorm = 2.7673, lr_0 = 9.9673e-04
Validation auc = 0.691096
Epoch 4927
Loss = 5.7535e-02, PNorm = 644.5199, GNorm = 2.2714, lr_0 = 9.9673e-04
Validation auc = 0.694295
Epoch 4928
Loss = 1.1424e-01, PNorm = 644.5913, GNorm = 5.1542, lr_0 = 9.9673e-04
Validation auc = 0.696386
Epoch 4929
Loss = 4.6780e-01, PNorm = 644.6563, GNorm = 9.1139, lr_0 = 9.9673e-04
Loss = 9.3403e-02, PNorm = 644.7251, GNorm = 8.9276, lr_0 = 9.9673e-04
Validation auc = 0.687342
Epoch 4930
Loss = 6.9697e-02, PNorm = 644.7975, GNorm = 0.3777, lr_0 = 9.9673e-04
Validation auc = 0.690931
Epoch 4931
Loss = 7.7243e-02, PNorm = 644.8590, GNorm = 2.4042, lr_0 = 9.9673e-04
Validation auc = 0.698493
Epoch 4932
Loss = 2.4956e-02, PNorm = 644.9080, GNorm = 3.3736, lr_0 = 9.9673e-04
Validation auc = 0.699107
Epoch 4933
Loss = 3.5586e-02, PNorm = 644.9461, GNorm = 2.2763, lr_0 = 9.9673e-04
Validation auc = 0.698677
Epoch 4934
Loss = 1.5753e-02, PNorm = 644.9805, GNorm = 0.2136, lr_0 = 9.9673e-04
Validation auc = 0.701417
Epoch 4935
Loss = 6.4386e-02, PNorm = 645.0160, GNorm = 2.7124, lr_0 = 9.9673e-04
Validation auc = 0.704908
Epoch 4936
Loss = 5.0257e-02, PNorm = 645.0739, GNorm = 0.7900, lr_0 = 9.9673e-04
Validation auc = 0.703684
Epoch 4937
Loss = 1.8804e-02, PNorm = 645.1187, GNorm = 0.9163, lr_0 = 9.9673e-04
Validation auc = 0.715440
Epoch 4938
Loss = 1.2790e-01, PNorm = 645.1714, GNorm = 3.9294, lr_0 = 9.9673e-04
Validation auc = 0.715586
Epoch 4939
Loss = 1.1817e-01, PNorm = 645.2385, GNorm = 2.2624, lr_0 = 9.9673e-04
Loss = 2.9379e-02, PNorm = 645.2933, GNorm = 1.5283, lr_0 = 9.9672e-04
Validation auc = 0.715209
Epoch 4940
Loss = 5.8416e-02, PNorm = 645.3402, GNorm = 0.9310, lr_0 = 9.9672e-04
Validation auc = 0.699719
Epoch 4941
Loss = 4.4684e-02, PNorm = 645.3887, GNorm = 0.8508, lr_0 = 9.9672e-04
Validation auc = 0.692961
Epoch 4942
Loss = 6.3945e-02, PNorm = 645.4405, GNorm = 1.7442, lr_0 = 9.9672e-04
Validation auc = 0.694196
Epoch 4943
Loss = 6.2730e-02, PNorm = 645.4805, GNorm = 0.3067, lr_0 = 9.9672e-04
Validation auc = 0.693838
Epoch 4944
Loss = 7.3891e-02, PNorm = 645.5189, GNorm = 8.7290, lr_0 = 9.9672e-04
Validation auc = 0.687083
Epoch 4945
Loss = 3.3528e-02, PNorm = 645.5634, GNorm = 0.5838, lr_0 = 9.9672e-04
Validation auc = 0.687938
Epoch 4946
Loss = 8.5967e-02, PNorm = 645.6091, GNorm = 1.9961, lr_0 = 9.9672e-04
Validation auc = 0.681619
Epoch 4947
Loss = 7.5252e-03, PNorm = 645.6527, GNorm = 0.0645, lr_0 = 9.9672e-04
Validation auc = 0.679004
Epoch 4948
Loss = 4.5694e-02, PNorm = 645.6826, GNorm = 7.1672, lr_0 = 9.9672e-04
Validation auc = 0.682986
Epoch 4949
Loss = 1.2144e-02, PNorm = 645.7161, GNorm = 0.4939, lr_0 = 9.9672e-04
Loss = 7.4722e-02, PNorm = 645.7569, GNorm = 7.4227, lr_0 = 9.9672e-04
Validation auc = 0.685395
Epoch 4950
Loss = 4.2793e-02, PNorm = 645.8210, GNorm = 0.8543, lr_0 = 9.9672e-04
Validation auc = 0.684025
Epoch 4951
Loss = 5.5921e-02, PNorm = 645.8780, GNorm = 3.4250, lr_0 = 9.9672e-04
Validation auc = 0.687635
Epoch 4952
Loss = 2.6402e-02, PNorm = 645.9254, GNorm = 0.6410, lr_0 = 9.9671e-04
Validation auc = 0.689959
Epoch 4953
Loss = 2.9067e-02, PNorm = 645.9629, GNorm = 0.4983, lr_0 = 9.9671e-04
Validation auc = 0.692946
Epoch 4954
Loss = 4.0733e-02, PNorm = 646.0029, GNorm = 0.7370, lr_0 = 9.9671e-04
Validation auc = 0.697508
Epoch 4955
Loss = 1.4467e-02, PNorm = 646.0422, GNorm = 1.0709, lr_0 = 9.9671e-04
Validation auc = 0.704258
Epoch 4956
Loss = 1.7533e-02, PNorm = 646.0778, GNorm = 0.6428, lr_0 = 9.9671e-04
Validation auc = 0.696424
Epoch 4957
Loss = 4.6074e-03, PNorm = 646.1220, GNorm = 0.3160, lr_0 = 9.9671e-04
Validation auc = 0.686894
Epoch 4958
Loss = 1.3268e-01, PNorm = 646.2068, GNorm = 5.5793, lr_0 = 9.9671e-04
Validation auc = 0.698505
Epoch 4959
Loss = 2.2926e-02, PNorm = 646.3466, GNorm = 1.2648, lr_0 = 9.9671e-04
Loss = 9.5103e-02, PNorm = 646.4885, GNorm = 1.8367, lr_0 = 9.9671e-04
Validation auc = 0.707166
Epoch 4960
Loss = 8.4822e-02, PNorm = 646.5989, GNorm = 0.7781, lr_0 = 9.9671e-04
Validation auc = 0.712344
Epoch 4961
Loss = 9.2691e-02, PNorm = 646.6885, GNorm = 6.4994, lr_0 = 9.9671e-04
Validation auc = 0.701602
Epoch 4962
Loss = 1.4952e-01, PNorm = 646.7719, GNorm = 0.9743, lr_0 = 9.9671e-04
Validation auc = 0.695795
Epoch 4963
Loss = 6.2130e-02, PNorm = 646.8548, GNorm = 0.7890, lr_0 = 9.9671e-04
Validation auc = 0.692833
Epoch 4964
Loss = 5.6371e-02, PNorm = 646.9184, GNorm = 0.6647, lr_0 = 9.9671e-04
Validation auc = 0.689330
Epoch 4965
Loss = 6.3188e-02, PNorm = 646.9624, GNorm = 0.8357, lr_0 = 9.9671e-04
Validation auc = 0.692352
Epoch 4966
Loss = 8.8960e-02, PNorm = 647.0125, GNorm = 1.4978, lr_0 = 9.9670e-04
Validation auc = 0.689493
Epoch 4967
Loss = 1.7876e-01, PNorm = 647.0800, GNorm = 0.5211, lr_0 = 9.9670e-04
Validation auc = 0.684989
Epoch 4968
Loss = 4.5018e-02, PNorm = 647.1683, GNorm = 1.8599, lr_0 = 9.9670e-04
Validation auc = 0.684799
Epoch 4969
Loss = 3.0575e-02, PNorm = 647.2459, GNorm = 0.9379, lr_0 = 9.9670e-04
Loss = 5.5355e-02, PNorm = 647.3116, GNorm = 5.0519, lr_0 = 9.9670e-04
Validation auc = 0.692401
Epoch 4970
Loss = 7.0484e-02, PNorm = 647.3831, GNorm = 2.8935, lr_0 = 9.9670e-04
Validation auc = 0.692595
Epoch 4971
Loss = 6.4066e-02, PNorm = 647.4568, GNorm = 6.7229, lr_0 = 9.9670e-04
Validation auc = 0.680690
Epoch 4972
Loss = 4.5068e-02, PNorm = 647.5290, GNorm = 0.7083, lr_0 = 9.9670e-04
Validation auc = 0.672979
Epoch 4973
Loss = 2.3669e-02, PNorm = 647.5827, GNorm = 1.8064, lr_0 = 9.9670e-04
Validation auc = 0.669233
Epoch 4974
Loss = 6.5817e-02, PNorm = 647.6350, GNorm = 0.3306, lr_0 = 9.9670e-04
Validation auc = 0.677000
Epoch 4975
Loss = 3.5643e-02, PNorm = 647.7048, GNorm = 2.6166, lr_0 = 9.9670e-04
Validation auc = 0.682910
Epoch 4976
Loss = 3.7073e-02, PNorm = 647.7661, GNorm = 5.5795, lr_0 = 9.9670e-04
Validation auc = 0.691176
Epoch 4977
Loss = 1.3698e-02, PNorm = 647.8215, GNorm = 0.5458, lr_0 = 9.9670e-04
Validation auc = 0.690405
Epoch 4978
Loss = 4.1526e-03, PNorm = 647.8766, GNorm = 0.2564, lr_0 = 9.9670e-04
Validation auc = 0.690417
Epoch 4979
Loss = 1.2999e-02, PNorm = 647.9246, GNorm = 0.6606, lr_0 = 9.9670e-04
Loss = 1.0188e-01, PNorm = 647.9688, GNorm = 2.6057, lr_0 = 9.9669e-04
Validation auc = 0.689704
Epoch 4980
Loss = 3.7394e-02, PNorm = 648.0221, GNorm = 2.9449, lr_0 = 9.9669e-04
Validation auc = 0.679540
Epoch 4981
Loss = 4.4502e-02, PNorm = 648.0660, GNorm = 4.7315, lr_0 = 9.9669e-04
Validation auc = 0.676354
Epoch 4982
Loss = 2.5490e-02, PNorm = 648.1100, GNorm = 1.3220, lr_0 = 9.9669e-04
Validation auc = 0.673727
Epoch 4983
Loss = 6.6426e-02, PNorm = 648.1496, GNorm = 1.3693, lr_0 = 9.9669e-04
Validation auc = 0.672557
Epoch 4984
Loss = 6.7680e-02, PNorm = 648.1908, GNorm = 0.7682, lr_0 = 9.9669e-04
Validation auc = 0.672398
Epoch 4985
Loss = 4.4918e-02, PNorm = 648.2369, GNorm = 3.0099, lr_0 = 9.9669e-04
Validation auc = 0.676567
Epoch 4986
Loss = 5.3846e-02, PNorm = 648.2918, GNorm = 3.6963, lr_0 = 9.9669e-04
Validation auc = 0.683191
Epoch 4987
Loss = 7.4233e-02, PNorm = 648.3502, GNorm = 5.4725, lr_0 = 9.9669e-04
Validation auc = 0.694781
Epoch 4988
Loss = 5.9971e-02, PNorm = 648.4134, GNorm = 2.6456, lr_0 = 9.9669e-04
Validation auc = 0.700267
Epoch 4989
Loss = 3.3801e-03, PNorm = 648.4928, GNorm = 0.2752, lr_0 = 9.9669e-04
Loss = 4.5350e-02, PNorm = 648.5666, GNorm = 6.6471, lr_0 = 9.9669e-04
Validation auc = 0.699951
Epoch 4990
Loss = 4.9230e-02, PNorm = 648.6242, GNorm = 2.0942, lr_0 = 9.9669e-04
Validation auc = 0.701492
Epoch 4991
Loss = 6.6234e-02, PNorm = 648.6744, GNorm = 1.6371, lr_0 = 9.9669e-04
Validation auc = 0.695418
Epoch 4992
Loss = 6.1798e-02, PNorm = 648.7338, GNorm = 0.9578, lr_0 = 9.9668e-04
Validation auc = 0.695889
Epoch 4993
Loss = 6.9680e-02, PNorm = 648.7943, GNorm = 0.7734, lr_0 = 9.9668e-04
Validation auc = 0.692756
Epoch 4994
Loss = 4.9861e-02, PNorm = 648.8482, GNorm = 1.5763, lr_0 = 9.9668e-04
Validation auc = 0.686785
Epoch 4995
Loss = 1.4487e-02, PNorm = 648.9009, GNorm = 0.3387, lr_0 = 9.9668e-04
Validation auc = 0.682227
Epoch 4996
Loss = 9.6618e-02, PNorm = 648.9509, GNorm = 0.4890, lr_0 = 9.9668e-04
Validation auc = 0.683924
Epoch 4997
Loss = 5.3003e-02, PNorm = 648.9945, GNorm = 3.2827, lr_0 = 9.9668e-04
Validation auc = 0.687967
Epoch 4998
Loss = 2.9056e-02, PNorm = 649.0327, GNorm = 2.0052, lr_0 = 9.9668e-04
Validation auc = 0.687700
Epoch 4999
Loss = 1.7296e-02, PNorm = 649.0698, GNorm = 1.0697, lr_0 = 9.9668e-04
Loss = 8.1200e-02, PNorm = 649.1078, GNorm = 3.4704, lr_0 = 9.9668e-04
Validation auc = 0.682063
Epoch 5000
Loss = 4.6289e-02, PNorm = 649.1555, GNorm = 0.9104, lr_0 = 9.9668e-04
Validation auc = 0.681910
Epoch 5001
Loss = 3.8014e-02, PNorm = 649.1972, GNorm = 0.9653, lr_0 = 9.9668e-04
Validation auc = 0.684569
Epoch 5002
Loss = 4.5596e-02, PNorm = 649.2430, GNorm = 0.3567, lr_0 = 9.9668e-04
Validation auc = 0.679928
Epoch 5003
Loss = 8.9586e-02, PNorm = 649.2968, GNorm = 3.4749, lr_0 = 9.9668e-04
Validation auc = 0.682876
Epoch 5004
Loss = 3.5233e-02, PNorm = 649.3529, GNorm = 2.9565, lr_0 = 9.9668e-04
Validation auc = 0.677149
Epoch 5005
Loss = 1.4006e-02, PNorm = 649.4105, GNorm = 0.5270, lr_0 = 9.9668e-04
Validation auc = 0.677963
Epoch 5006
Loss = 6.0487e-02, PNorm = 649.4543, GNorm = 3.0282, lr_0 = 9.9667e-04
Validation auc = 0.683532
Epoch 5007
Loss = 5.4919e-02, PNorm = 649.5065, GNorm = 0.2316, lr_0 = 9.9667e-04
Validation auc = 0.688836
Epoch 5008
Loss = 4.3176e-02, PNorm = 649.5638, GNorm = 1.2627, lr_0 = 9.9667e-04
Validation auc = 0.695990
Epoch 5009
Loss = 7.1196e-02, PNorm = 649.6172, GNorm = 2.4827, lr_0 = 9.9667e-04
Loss = 6.2259e-02, PNorm = 649.6652, GNorm = 0.1889, lr_0 = 9.9667e-04
Validation auc = 0.701052
Epoch 5010
Loss = 4.5278e-02, PNorm = 649.7102, GNorm = 2.1512, lr_0 = 9.9667e-04
Validation auc = 0.699017
Epoch 5011
Loss = 4.1341e-02, PNorm = 649.7609, GNorm = 0.1481, lr_0 = 9.9667e-04
Validation auc = 0.697534
Epoch 5012
Loss = 1.0558e-01, PNorm = 649.8191, GNorm = 1.1320, lr_0 = 9.9667e-04
Validation auc = 0.697745
Epoch 5013
Loss = 3.4838e-02, PNorm = 649.8959, GNorm = 0.4523, lr_0 = 9.9667e-04
Validation auc = 0.693680
Epoch 5014
Loss = 6.1753e-02, PNorm = 649.9530, GNorm = 1.2487, lr_0 = 9.9667e-04
Validation auc = 0.693442
Epoch 5015
Loss = 6.6148e-02, PNorm = 649.9995, GNorm = 1.9406, lr_0 = 9.9667e-04
Validation auc = 0.695696
Epoch 5016
Loss = 1.8240e-02, PNorm = 650.0420, GNorm = 0.3487, lr_0 = 9.9667e-04
Validation auc = 0.689915
Epoch 5017
Loss = 8.7538e-02, PNorm = 650.0793, GNorm = 4.1913, lr_0 = 9.9667e-04
Validation auc = 0.681902
Epoch 5018
Loss = 4.8444e-02, PNorm = 650.1196, GNorm = 0.4229, lr_0 = 9.9667e-04
Validation auc = 0.678804
Epoch 5019
Loss = 5.9068e-03, PNorm = 650.1610, GNorm = 0.2483, lr_0 = 9.9666e-04
Loss = 2.4688e-02, PNorm = 650.2026, GNorm = 0.8986, lr_0 = 9.9666e-04
Validation auc = 0.680416
Epoch 5020
Loss = 4.0319e-02, PNorm = 650.2400, GNorm = 1.1201, lr_0 = 9.9666e-04
Validation auc = 0.689793
Epoch 5021
Loss = 2.6004e-02, PNorm = 650.2764, GNorm = 1.8047, lr_0 = 9.9666e-04
Validation auc = 0.698390
Epoch 5022
Loss = 7.5798e-02, PNorm = 650.3116, GNorm = 0.3612, lr_0 = 9.9666e-04
Validation auc = 0.701454
Epoch 5023
Loss = 4.4354e-02, PNorm = 650.3475, GNorm = 0.2672, lr_0 = 9.9666e-04
Validation auc = 0.700924
Epoch 5024
Loss = 5.7627e-02, PNorm = 650.3864, GNorm = 3.2898, lr_0 = 9.9666e-04
Validation auc = 0.698619
Epoch 5025
Loss = 1.6876e-02, PNorm = 650.4273, GNorm = 0.6236, lr_0 = 9.9666e-04
Validation auc = 0.700681
Epoch 5026
Loss = 6.0115e-02, PNorm = 650.4571, GNorm = 7.9012, lr_0 = 9.9666e-04
Validation auc = 0.711180
Epoch 5027
Loss = 4.8598e-02, PNorm = 650.5025, GNorm = 3.2506, lr_0 = 9.9666e-04
Validation auc = 0.704485
Epoch 5028
Loss = 6.3772e-02, PNorm = 650.5618, GNorm = 1.0498, lr_0 = 9.9666e-04
Validation auc = 0.699226
Epoch 5029
Loss = 4.7576e-03, PNorm = 650.6200, GNorm = 0.3449, lr_0 = 9.9666e-04
Loss = 1.1917e-01, PNorm = 650.6730, GNorm = 3.9744, lr_0 = 9.9666e-04
Validation auc = 0.700922
Epoch 5030
Loss = 7.9427e-02, PNorm = 650.7380, GNorm = 3.4281, lr_0 = 9.9666e-04
Validation auc = 0.702624
Epoch 5031
Loss = 6.5532e-02, PNorm = 650.8042, GNorm = 1.2339, lr_0 = 9.9666e-04
Validation auc = 0.706327
Epoch 5032
Loss = 4.4000e-02, PNorm = 650.8839, GNorm = 2.0141, lr_0 = 9.9665e-04
Validation auc = 0.711775
Epoch 5033
Loss = 4.5099e-02, PNorm = 650.9540, GNorm = 0.5520, lr_0 = 9.9665e-04
Validation auc = 0.715284
Epoch 5034
Loss = 5.5207e-02, PNorm = 651.0054, GNorm = 0.1994, lr_0 = 9.9665e-04
Validation auc = 0.705730
Epoch 5035
Loss = 1.0899e-01, PNorm = 651.0659, GNorm = 3.8993, lr_0 = 9.9665e-04
Validation auc = 0.691023
Epoch 5036
Loss = 1.0398e-01, PNorm = 651.1234, GNorm = 2.3977, lr_0 = 9.9665e-04
Validation auc = 0.681343
Epoch 5037
Loss = 3.4158e-02, PNorm = 651.1792, GNorm = 2.6511, lr_0 = 9.9665e-04
Validation auc = 0.680568
Epoch 5038
Loss = 3.2897e-02, PNorm = 651.2294, GNorm = 2.2105, lr_0 = 9.9665e-04
Validation auc = 0.686337
Epoch 5039
Loss = 1.0121e-01, PNorm = 651.2735, GNorm = 2.5533, lr_0 = 9.9665e-04
Loss = 4.3995e-02, PNorm = 651.3206, GNorm = 4.6245, lr_0 = 9.9665e-04
Validation auc = 0.687760
Epoch 5040
Loss = 2.8065e-02, PNorm = 651.3617, GNorm = 2.6203, lr_0 = 9.9665e-04
Validation auc = 0.687511
Epoch 5041
Loss = 2.4942e-02, PNorm = 651.4040, GNorm = 1.0403, lr_0 = 9.9665e-04
Validation auc = 0.696537
Epoch 5042
Loss = 2.5180e-02, PNorm = 651.4457, GNorm = 0.6877, lr_0 = 9.9665e-04
Validation auc = 0.702633
Epoch 5043
Loss = 5.4919e-02, PNorm = 651.4896, GNorm = 3.2631, lr_0 = 9.9665e-04
Validation auc = 0.703209
Epoch 5044
Loss = 2.0526e-02, PNorm = 651.5412, GNorm = 0.6703, lr_0 = 9.9665e-04
Validation auc = 0.700785
Epoch 5045
Loss = 9.9878e-02, PNorm = 651.5740, GNorm = 5.5945, lr_0 = 9.9664e-04
Validation auc = 0.694584
Epoch 5046
Loss = 2.7361e-02, PNorm = 651.6072, GNorm = 1.6502, lr_0 = 9.9664e-04
Validation auc = 0.697047
Epoch 5047
Loss = 1.0488e-02, PNorm = 651.6549, GNorm = 1.0351, lr_0 = 9.9664e-04
Validation auc = 0.701862
Epoch 5048
Loss = 7.6100e-02, PNorm = 651.6930, GNorm = 2.3938, lr_0 = 9.9664e-04
Validation auc = 0.706692
Epoch 5049
Loss = 3.9007e-02, PNorm = 651.7248, GNorm = 4.0171, lr_0 = 9.9664e-04
Loss = 5.9261e-02, PNorm = 651.7597, GNorm = 6.4115, lr_0 = 9.9664e-04
Validation auc = 0.700522
Epoch 5050
Loss = 4.3168e-02, PNorm = 651.8184, GNorm = 0.3423, lr_0 = 9.9664e-04
Validation auc = 0.694722
Epoch 5051
Loss = 1.6423e-02, PNorm = 651.8764, GNorm = 0.0154, lr_0 = 9.9664e-04
Validation auc = 0.695293
Epoch 5052
Loss = 6.2931e-02, PNorm = 651.9239, GNorm = 5.7981, lr_0 = 9.9664e-04
Validation auc = 0.696363
Epoch 5053
Loss = 7.6482e-02, PNorm = 651.9734, GNorm = 5.0370, lr_0 = 9.9664e-04
Validation auc = 0.703845
Epoch 5054
Loss = 4.7867e-02, PNorm = 652.0454, GNorm = 2.0603, lr_0 = 9.9664e-04
Validation auc = 0.710693
Epoch 5055
Loss = 2.7065e-02, PNorm = 652.1096, GNorm = 0.4435, lr_0 = 9.9664e-04
Validation auc = 0.714875
Epoch 5056
Loss = 1.7119e-02, PNorm = 652.1570, GNorm = 0.1527, lr_0 = 9.9664e-04
Validation auc = 0.721129
Epoch 5057
Loss = 6.6629e-02, PNorm = 652.1886, GNorm = 0.2926, lr_0 = 9.9664e-04
Validation auc = 0.717782
Epoch 5058
Loss = 6.6082e-03, PNorm = 652.2265, GNorm = 0.2387, lr_0 = 9.9664e-04
Validation auc = 0.713622
Epoch 5059
Loss = 6.0345e-02, PNorm = 652.2682, GNorm = 1.5369, lr_0 = 9.9663e-04
Loss = 3.4822e-02, PNorm = 652.3078, GNorm = 2.0001, lr_0 = 9.9663e-04
Validation auc = 0.716533
Epoch 5060
Loss = 4.3839e-02, PNorm = 652.3428, GNorm = 3.4568, lr_0 = 9.9663e-04
Validation auc = 0.722916
Epoch 5061
Loss = 6.5358e-02, PNorm = 652.3843, GNorm = 5.4156, lr_0 = 9.9663e-04
Validation auc = 0.714194
Epoch 5062
Loss = 2.1039e-02, PNorm = 652.4290, GNorm = 2.1827, lr_0 = 9.9663e-04
Validation auc = 0.710974
Epoch 5063
Loss = 1.7653e-02, PNorm = 652.4671, GNorm = 1.7347, lr_0 = 9.9663e-04
Validation auc = 0.715455
Epoch 5064
Loss = 8.7352e-03, PNorm = 652.4929, GNorm = 0.1985, lr_0 = 9.9663e-04
Validation auc = 0.715541
Epoch 5065
Loss = 3.0169e-02, PNorm = 652.5134, GNorm = 5.2202, lr_0 = 9.9663e-04
Validation auc = 0.705653
Epoch 5066
Loss = 2.7369e-02, PNorm = 652.5475, GNorm = 1.7088, lr_0 = 9.9663e-04
Validation auc = 0.692898
Epoch 5067
Loss = 2.3605e-02, PNorm = 652.5908, GNorm = 2.7480, lr_0 = 9.9663e-04
Validation auc = 0.689464
Epoch 5068
Loss = 2.2910e-02, PNorm = 652.6486, GNorm = 0.8760, lr_0 = 9.9663e-04
Validation auc = 0.690474
Epoch 5069
Loss = 1.6695e-02, PNorm = 652.6979, GNorm = 2.1586, lr_0 = 9.9663e-04
Loss = 3.6715e-02, PNorm = 652.7457, GNorm = 0.8916, lr_0 = 9.9663e-04
Validation auc = 0.692589
Epoch 5070
Loss = 3.3658e-02, PNorm = 652.8021, GNorm = 1.1672, lr_0 = 9.9663e-04
Validation auc = 0.696142
Epoch 5071
Loss = 9.3070e-02, PNorm = 652.8511, GNorm = 2.3828, lr_0 = 9.9663e-04
Validation auc = 0.699787
Epoch 5072
Loss = 7.2755e-02, PNorm = 652.9014, GNorm = 0.3346, lr_0 = 9.9662e-04
Validation auc = 0.692884
Epoch 5073
Loss = 4.4962e-02, PNorm = 652.9463, GNorm = 1.8493, lr_0 = 9.9662e-04
Validation auc = 0.692359
Epoch 5074
Loss = 4.7940e-02, PNorm = 652.9846, GNorm = 1.5181, lr_0 = 9.9662e-04
Validation auc = 0.694407
Epoch 5075
Loss = 5.1929e-02, PNorm = 653.0279, GNorm = 0.1551, lr_0 = 9.9662e-04
Validation auc = 0.697600
Epoch 5076
Loss = 1.8465e-02, PNorm = 653.0780, GNorm = 0.5569, lr_0 = 9.9662e-04
Validation auc = 0.703081
Epoch 5077
Loss = 5.7402e-02, PNorm = 653.1165, GNorm = 2.7712, lr_0 = 9.9662e-04
Validation auc = 0.706244
Epoch 5078
Loss = 1.1783e-01, PNorm = 653.1619, GNorm = 1.7957, lr_0 = 9.9662e-04
Validation auc = 0.698687
Epoch 5079
Loss = 1.3064e-01, PNorm = 653.2098, GNorm = 4.1150, lr_0 = 9.9662e-04
Loss = 4.1134e-02, PNorm = 653.2526, GNorm = 0.8570, lr_0 = 9.9662e-04
Validation auc = 0.688324
Epoch 5080
Loss = 4.6098e-02, PNorm = 653.2845, GNorm = 3.3993, lr_0 = 9.9662e-04
Validation auc = 0.687049
Epoch 5081
Loss = 2.3320e-02, PNorm = 653.3215, GNorm = 1.9172, lr_0 = 9.9662e-04
Validation auc = 0.692650
Epoch 5082
Loss = 4.3948e-02, PNorm = 653.3615, GNorm = 0.6148, lr_0 = 9.9662e-04
Validation auc = 0.697211
Epoch 5083
Loss = 2.8189e-02, PNorm = 653.4123, GNorm = 0.0705, lr_0 = 9.9662e-04
Validation auc = 0.702392
Epoch 5084
Loss = 4.6442e-02, PNorm = 653.4705, GNorm = 1.6777, lr_0 = 9.9662e-04
Validation auc = 0.714330
Epoch 5085
Loss = 3.8477e-02, PNorm = 653.5348, GNorm = 4.2020, lr_0 = 9.9661e-04
Validation auc = 0.719881
Epoch 5086
Loss = 9.6466e-03, PNorm = 653.6010, GNorm = 0.2025, lr_0 = 9.9661e-04
Validation auc = 0.717468
Epoch 5087
Loss = 1.1272e-01, PNorm = 653.6781, GNorm = 4.6737, lr_0 = 9.9661e-04
Validation auc = 0.721245
Epoch 5088
Loss = 1.7601e-01, PNorm = 653.7889, GNorm = 7.5424, lr_0 = 9.9661e-04
Validation auc = 0.718584
Epoch 5089
Loss = 5.5087e-03, PNorm = 653.8859, GNorm = 0.3457, lr_0 = 9.9661e-04
Loss = 9.5924e-02, PNorm = 653.9611, GNorm = 0.7608, lr_0 = 9.9661e-04
Validation auc = 0.711779
Epoch 5090
Loss = 4.0013e-02, PNorm = 654.0315, GNorm = 0.2868, lr_0 = 9.9661e-04
Validation auc = 0.706399
Epoch 5091
Loss = 4.6086e-02, PNorm = 654.0895, GNorm = 3.9172, lr_0 = 9.9661e-04
Validation auc = 0.702120
Epoch 5092
Loss = 2.8581e-02, PNorm = 654.1412, GNorm = 0.1226, lr_0 = 9.9661e-04
Validation auc = 0.696042
Epoch 5093
Loss = 8.1868e-02, PNorm = 654.1876, GNorm = 3.4531, lr_0 = 9.9661e-04
Validation auc = 0.692339
Epoch 5094
Loss = 8.5118e-02, PNorm = 654.2546, GNorm = 0.5306, lr_0 = 9.9661e-04
Validation auc = 0.691882
Epoch 5095
Loss = 8.9193e-02, PNorm = 654.3435, GNorm = 11.3241, lr_0 = 9.9661e-04
Validation auc = 0.693242
Epoch 5096
Loss = 3.9489e-02, PNorm = 654.4328, GNorm = 0.2473, lr_0 = 9.9661e-04
Validation auc = 0.698311
Epoch 5097
Loss = 3.3441e-02, PNorm = 654.5075, GNorm = 2.0708, lr_0 = 9.9661e-04
Validation auc = 0.694742
Epoch 5098
Loss = 3.7931e-02, PNorm = 654.5746, GNorm = 1.8392, lr_0 = 9.9661e-04
Validation auc = 0.694667
Epoch 5099
Loss = 8.8088e-03, PNorm = 654.6380, GNorm = 0.3832, lr_0 = 9.9660e-04
Loss = 5.4338e-02, PNorm = 654.6983, GNorm = 2.3737, lr_0 = 9.9660e-04
Validation auc = 0.688677
Epoch 5100
Loss = 5.5877e-02, PNorm = 654.7618, GNorm = 0.4674, lr_0 = 9.9660e-04
Validation auc = 0.673730
Epoch 5101
Loss = 7.1562e-02, PNorm = 654.8246, GNorm = 2.0760, lr_0 = 9.9660e-04
Validation auc = 0.674206
Epoch 5102
Loss = 8.5504e-02, PNorm = 654.9091, GNorm = 1.1906, lr_0 = 9.9660e-04
Validation auc = 0.670578
Epoch 5103
Loss = 4.5589e-02, PNorm = 654.9874, GNorm = 1.0521, lr_0 = 9.9660e-04
Validation auc = 0.670983
Epoch 5104
Loss = 2.8298e-02, PNorm = 655.0464, GNorm = 0.6484, lr_0 = 9.9660e-04
Validation auc = 0.670202
Epoch 5105
Loss = 4.6299e-02, PNorm = 655.0894, GNorm = 0.8414, lr_0 = 9.9660e-04
Validation auc = 0.668237
Epoch 5106
Loss = 6.2342e-02, PNorm = 655.1248, GNorm = 2.9528, lr_0 = 9.9660e-04
Validation auc = 0.665249
Epoch 5107
Loss = 6.1156e-02, PNorm = 655.1606, GNorm = 0.7919, lr_0 = 9.9660e-04
Validation auc = 0.662118
Epoch 5108
Loss = 7.6589e-03, PNorm = 655.2026, GNorm = 0.5218, lr_0 = 9.9660e-04
Validation auc = 0.659125
Epoch 5109
Loss = 1.0215e-02, PNorm = 655.2576, GNorm = 0.6316, lr_0 = 9.9660e-04
Loss = 2.4129e-02, PNorm = 655.3126, GNorm = 0.2465, lr_0 = 9.9660e-04
Validation auc = 0.666613
Epoch 5110
Loss = 4.9814e-02, PNorm = 655.3605, GNorm = 1.0442, lr_0 = 9.9660e-04
Validation auc = 0.674708
Epoch 5111
Loss = 7.3386e-02, PNorm = 655.4260, GNorm = 1.3433, lr_0 = 9.9659e-04
Validation auc = 0.673384
Epoch 5112
Loss = 7.2297e-02, PNorm = 655.4863, GNorm = 10.2997, lr_0 = 9.9659e-04
Validation auc = 0.666923
Epoch 5113
Loss = 3.7524e-02, PNorm = 655.5486, GNorm = 0.5018, lr_0 = 9.9659e-04
Validation auc = 0.666006
Epoch 5114
Loss = 3.9556e-02, PNorm = 655.6070, GNorm = 0.4447, lr_0 = 9.9659e-04
Validation auc = 0.667077
Epoch 5115
Loss = 5.0243e-02, PNorm = 655.6516, GNorm = 3.1681, lr_0 = 9.9659e-04
Validation auc = 0.669578
Epoch 5116
Loss = 4.2135e-02, PNorm = 655.6904, GNorm = 4.2084, lr_0 = 9.9659e-04
Validation auc = 0.671361
Epoch 5117
Loss = 2.2945e-02, PNorm = 655.7294, GNorm = 1.1293, lr_0 = 9.9659e-04
Validation auc = 0.675680
Epoch 5118
Loss = 6.2828e-03, PNorm = 655.7682, GNorm = 0.0907, lr_0 = 9.9659e-04
Validation auc = 0.679376
Epoch 5119
Loss = 2.3753e-03, PNorm = 655.8003, GNorm = 0.3821, lr_0 = 9.9659e-04
Loss = 5.1779e-02, PNorm = 655.8311, GNorm = 0.3500, lr_0 = 9.9659e-04
Validation auc = 0.677245
Epoch 5120
Loss = 1.9121e-02, PNorm = 655.8657, GNorm = 3.1343, lr_0 = 9.9659e-04
Validation auc = 0.676127
Epoch 5121
Loss = 3.0719e-02, PNorm = 655.9013, GNorm = 0.5260, lr_0 = 9.9659e-04
Validation auc = 0.684014
Epoch 5122
Loss = 3.0041e-02, PNorm = 655.9377, GNorm = 0.3303, lr_0 = 9.9659e-04
Validation auc = 0.687304
Epoch 5123
Loss = 4.0005e-02, PNorm = 655.9721, GNorm = 1.7498, lr_0 = 9.9659e-04
Validation auc = 0.684124
Epoch 5124
Loss = 8.4207e-03, PNorm = 656.0055, GNorm = 1.2874, lr_0 = 9.9659e-04
Validation auc = 0.674378
Epoch 5125
Loss = 9.2652e-03, PNorm = 656.0392, GNorm = 0.7378, lr_0 = 9.9658e-04
Validation auc = 0.666689
Epoch 5126
Loss = 2.1631e-02, PNorm = 656.0766, GNorm = 0.6442, lr_0 = 9.9658e-04
Validation auc = 0.666082
Epoch 5127
Loss = 4.2641e-02, PNorm = 656.1213, GNorm = 0.4591, lr_0 = 9.9658e-04
Validation auc = 0.678591
Epoch 5128
Loss = 1.1251e-01, PNorm = 656.1835, GNorm = 0.1075, lr_0 = 9.9658e-04
Validation auc = 0.702835
Epoch 5129
Loss = 3.9735e-02, PNorm = 656.2770, GNorm = 1.3863, lr_0 = 9.9658e-04
Loss = 9.2106e-02, PNorm = 656.3871, GNorm = 2.1314, lr_0 = 9.9658e-04
Validation auc = 0.710071
Epoch 5130
Loss = 8.1066e-02, PNorm = 656.4737, GNorm = 8.5470, lr_0 = 9.9658e-04
Validation auc = 0.710970
Epoch 5131
Loss = 3.4817e-02, PNorm = 656.5383, GNorm = 0.7794, lr_0 = 9.9658e-04
Validation auc = 0.716757
Epoch 5132
Loss = 9.1074e-02, PNorm = 656.5910, GNorm = 6.7219, lr_0 = 9.9658e-04
Validation auc = 0.715823
Epoch 5133
Loss = 3.4805e-02, PNorm = 656.6542, GNorm = 0.8102, lr_0 = 9.9658e-04
Validation auc = 0.708490
Epoch 5134
Loss = 2.5999e-02, PNorm = 656.7065, GNorm = 0.2735, lr_0 = 9.9658e-04
Validation auc = 0.701384
Epoch 5135
Loss = 2.4620e-02, PNorm = 656.7805, GNorm = 0.5929, lr_0 = 9.9658e-04
Validation auc = 0.694798
Epoch 5136
Loss = 2.5376e-02, PNorm = 656.8416, GNorm = 3.5775, lr_0 = 9.9658e-04
Validation auc = 0.702038
Epoch 5137
Loss = 5.8387e-03, PNorm = 656.8972, GNorm = 0.9115, lr_0 = 9.9658e-04
Validation auc = 0.701857
Epoch 5138
Loss = 4.2497e-02, PNorm = 656.9557, GNorm = 1.3788, lr_0 = 9.9657e-04
Validation auc = 0.698461
Epoch 5139
Loss = 1.5572e-01, PNorm = 657.0205, GNorm = 5.0117, lr_0 = 9.9657e-04
Loss = 2.6675e-02, PNorm = 657.0712, GNorm = 1.1704, lr_0 = 9.9657e-04
Validation auc = 0.695722
Epoch 5140
Loss = 8.7051e-02, PNorm = 657.1294, GNorm = 1.3444, lr_0 = 9.9657e-04
Validation auc = 0.688058
Epoch 5141
Loss = 1.1723e-01, PNorm = 657.1969, GNorm = 4.5535, lr_0 = 9.9657e-04
Validation auc = 0.682445
Epoch 5142
Loss = 3.3685e-02, PNorm = 657.2633, GNorm = 1.6716, lr_0 = 9.9657e-04
Validation auc = 0.683020
Epoch 5143
Loss = 3.1501e-02, PNorm = 657.3234, GNorm = 1.6490, lr_0 = 9.9657e-04
Validation auc = 0.686236
Epoch 5144
Loss = 7.6122e-02, PNorm = 657.3730, GNorm = 5.9394, lr_0 = 9.9657e-04
Validation auc = 0.680432
Epoch 5145
Loss = 1.1408e-01, PNorm = 657.4300, GNorm = 8.9070, lr_0 = 9.9657e-04
Validation auc = 0.687446
Epoch 5146
Loss = 1.3566e-01, PNorm = 657.4956, GNorm = 3.0808, lr_0 = 9.9657e-04
Validation auc = 0.673652
Epoch 5147
Loss = 1.0848e-01, PNorm = 657.5779, GNorm = 0.9714, lr_0 = 9.9657e-04
Validation auc = 0.661248
Epoch 5148
Loss = 7.5957e-02, PNorm = 657.6577, GNorm = 2.7555, lr_0 = 9.9657e-04
Validation auc = 0.657750
Epoch 5149
Loss = 1.9223e-02, PNorm = 657.7228, GNorm = 0.8152, lr_0 = 9.9657e-04
Loss = 8.7517e-02, PNorm = 657.7948, GNorm = 8.5815, lr_0 = 9.9657e-04
Validation auc = 0.663046
Epoch 5150
Loss = 4.6260e-02, PNorm = 657.8774, GNorm = 0.2623, lr_0 = 9.9657e-04
Validation auc = 0.669565
Epoch 5151
Loss = 4.4775e-02, PNorm = 657.9454, GNorm = 1.5517, lr_0 = 9.9656e-04
Validation auc = 0.675443
Epoch 5152
Loss = 3.2381e-02, PNorm = 658.0033, GNorm = 0.5489, lr_0 = 9.9656e-04
Validation auc = 0.683524
Epoch 5153
Loss = 2.9259e-02, PNorm = 658.0518, GNorm = 4.8720, lr_0 = 9.9656e-04
Validation auc = 0.679437
Epoch 5154
Loss = 6.9666e-02, PNorm = 658.1040, GNorm = 0.4062, lr_0 = 9.9656e-04
Validation auc = 0.669871
Epoch 5155
Loss = 8.6423e-02, PNorm = 658.1778, GNorm = 1.0123, lr_0 = 9.9656e-04
Validation auc = 0.674240
Epoch 5156
Loss = 5.4955e-02, PNorm = 658.2543, GNorm = 0.2863, lr_0 = 9.9656e-04
Validation auc = 0.682320
Epoch 5157
Loss = 2.6308e-02, PNorm = 658.3130, GNorm = 0.8831, lr_0 = 9.9656e-04
Validation auc = 0.686791
Epoch 5158
Loss = 1.4459e-02, PNorm = 658.3663, GNorm = 0.4311, lr_0 = 9.9656e-04
Validation auc = 0.685045
Epoch 5159
Loss = 9.2351e-03, PNorm = 658.4081, GNorm = 0.4381, lr_0 = 9.9656e-04
Loss = 4.7738e-02, PNorm = 658.4422, GNorm = 0.7739, lr_0 = 9.9656e-04
Validation auc = 0.680220
Epoch 5160
Loss = 3.8992e-02, PNorm = 658.4797, GNorm = 1.9243, lr_0 = 9.9656e-04
Validation auc = 0.680825
Epoch 5161
Loss = 1.5457e-02, PNorm = 658.5195, GNorm = 0.1615, lr_0 = 9.9656e-04
Validation auc = 0.679032
Epoch 5162
Loss = 5.6439e-02, PNorm = 658.5607, GNorm = 0.5696, lr_0 = 9.9656e-04
Validation auc = 0.681340
Epoch 5163
Loss = 2.5754e-02, PNorm = 658.6082, GNorm = 4.1829, lr_0 = 9.9656e-04
Validation auc = 0.682545
Epoch 5164
Loss = 5.5727e-02, PNorm = 658.6462, GNorm = 0.0398, lr_0 = 9.9656e-04
Validation auc = 0.683544
Epoch 5165
Loss = 2.1056e-02, PNorm = 658.6865, GNorm = 0.2777, lr_0 = 9.9655e-04
Validation auc = 0.688239
Epoch 5166
Loss = 4.6807e-02, PNorm = 658.7311, GNorm = 0.9060, lr_0 = 9.9655e-04
Validation auc = 0.671403
Epoch 5167
Loss = 4.7390e-02, PNorm = 658.7758, GNorm = 0.6074, lr_0 = 9.9655e-04
Validation auc = 0.659688
Epoch 5168
Loss = 1.1169e-01, PNorm = 658.8205, GNorm = 3.1521, lr_0 = 9.9655e-04
Validation auc = 0.653256
Epoch 5169
Loss = 2.0569e-01, PNorm = 658.8621, GNorm = 6.0349, lr_0 = 9.9655e-04
Loss = 3.1088e-02, PNorm = 658.8984, GNorm = 1.5851, lr_0 = 9.9655e-04
Validation auc = 0.658385
Epoch 5170
Loss = 3.9093e-02, PNorm = 658.9383, GNorm = 3.5343, lr_0 = 9.9655e-04
Validation auc = 0.671629
Epoch 5171
Loss = 6.1587e-02, PNorm = 658.9831, GNorm = 2.3685, lr_0 = 9.9655e-04
Validation auc = 0.683385
Epoch 5172
Loss = 2.3159e-02, PNorm = 659.0360, GNorm = 2.7172, lr_0 = 9.9655e-04
Validation auc = 0.681050
Epoch 5173
Loss = 5.4632e-02, PNorm = 659.0952, GNorm = 1.9863, lr_0 = 9.9655e-04
Validation auc = 0.679582
Epoch 5174
Loss = 1.6049e-02, PNorm = 659.1425, GNorm = 0.4710, lr_0 = 9.9655e-04
Validation auc = 0.669573
Epoch 5175
Loss = 1.9815e-02, PNorm = 659.1805, GNorm = 5.4035, lr_0 = 9.9655e-04
Validation auc = 0.669380
Epoch 5176
Loss = 4.4942e-02, PNorm = 659.2243, GNorm = 6.7052, lr_0 = 9.9655e-04
Validation auc = 0.676181
Epoch 5177
Loss = 9.8445e-02, PNorm = 659.2777, GNorm = 10.6349, lr_0 = 9.9655e-04
Validation auc = 0.689472
Epoch 5178
Loss = 3.2409e-02, PNorm = 659.3383, GNorm = 0.6938, lr_0 = 9.9654e-04
Validation auc = 0.689213
Epoch 5179
Loss = 1.0956e-02, PNorm = 659.3916, GNorm = 0.5167, lr_0 = 9.9654e-04
Loss = 4.2824e-02, PNorm = 659.4364, GNorm = 4.7720, lr_0 = 9.9654e-04
Validation auc = 0.686014
Epoch 5180
Loss = 4.1971e-02, PNorm = 659.4782, GNorm = 0.7950, lr_0 = 9.9654e-04
Validation auc = 0.685172
Epoch 5181
Loss = 5.9271e-02, PNorm = 659.5188, GNorm = 14.2123, lr_0 = 9.9654e-04
Validation auc = 0.689782
Epoch 5182
Loss = 3.4372e-02, PNorm = 659.5772, GNorm = 1.0726, lr_0 = 9.9654e-04
Validation auc = 0.702821
Epoch 5183
Loss = 3.9879e-02, PNorm = 659.6354, GNorm = 3.0029, lr_0 = 9.9654e-04
Validation auc = 0.705624
Epoch 5184
Loss = 6.2701e-02, PNorm = 659.6907, GNorm = 0.2623, lr_0 = 9.9654e-04
Validation auc = 0.705217
Epoch 5185
Loss = 9.4701e-02, PNorm = 659.7472, GNorm = 0.6791, lr_0 = 9.9654e-04
Validation auc = 0.700953
Epoch 5186
Loss = 1.0851e-01, PNorm = 659.8173, GNorm = 2.4649, lr_0 = 9.9654e-04
Validation auc = 0.692080
Epoch 5187
Loss = 1.1685e-01, PNorm = 659.9140, GNorm = 5.1405, lr_0 = 9.9654e-04
Validation auc = 0.683712
Epoch 5188
Loss = 9.7443e-02, PNorm = 659.9964, GNorm = 6.2286, lr_0 = 9.9654e-04
Validation auc = 0.682209
Epoch 5189
Loss = 2.4597e-02, PNorm = 660.0755, GNorm = 3.1463, lr_0 = 9.9654e-04
Loss = 9.0758e-02, PNorm = 660.1469, GNorm = 0.7528, lr_0 = 9.9654e-04
Validation auc = 0.677741
Epoch 5190
Loss = 9.2599e-02, PNorm = 660.2208, GNorm = 0.9990, lr_0 = 9.9654e-04
Validation auc = 0.694386
Epoch 5191
Loss = 4.3773e-02, PNorm = 660.2885, GNorm = 3.7707, lr_0 = 9.9653e-04
Validation auc = 0.690678
Epoch 5192
Loss = 6.1523e-02, PNorm = 660.3515, GNorm = 0.5039, lr_0 = 9.9653e-04
Validation auc = 0.693459
Epoch 5193
Loss = 2.6731e-02, PNorm = 660.3982, GNorm = 2.7110, lr_0 = 9.9653e-04
Validation auc = 0.698570
Epoch 5194
Loss = 1.0117e-01, PNorm = 660.4451, GNorm = 4.0407, lr_0 = 9.9653e-04
Validation auc = 0.692077
Epoch 5195
Loss = 4.6197e-02, PNorm = 660.5085, GNorm = 2.5674, lr_0 = 9.9653e-04
Validation auc = 0.690762
Epoch 5196
Loss = 7.0973e-02, PNorm = 660.5641, GNorm = 0.1622, lr_0 = 9.9653e-04
Validation auc = 0.694588
Epoch 5197
Loss = 3.3389e-02, PNorm = 660.6253, GNorm = 0.5760, lr_0 = 9.9653e-04
Validation auc = 0.692586
Epoch 5198
Loss = 3.6232e-02, PNorm = 660.6959, GNorm = 1.4181, lr_0 = 9.9653e-04
Validation auc = 0.695432
Epoch 5199
Loss = 2.9279e-02, PNorm = 660.7536, GNorm = 1.6506, lr_0 = 9.9653e-04
Loss = 3.3317e-02, PNorm = 660.8032, GNorm = 0.2011, lr_0 = 9.9653e-04
Validation auc = 0.704801
Epoch 5200
Loss = 1.6304e-02, PNorm = 660.8394, GNorm = 0.8274, lr_0 = 9.9653e-04
Validation auc = 0.707162
Epoch 5201
Loss = 3.3941e-02, PNorm = 660.8650, GNorm = 0.6889, lr_0 = 9.9653e-04
Validation auc = 0.703977
Epoch 5202
Loss = 8.8894e-02, PNorm = 660.9095, GNorm = 1.6617, lr_0 = 9.9653e-04
Validation auc = 0.700618
Epoch 5203
Loss = 1.4521e-01, PNorm = 660.9904, GNorm = 20.7118, lr_0 = 9.9653e-04
Validation auc = 0.673077
Epoch 5204
Loss = 2.1801e-02, PNorm = 661.1007, GNorm = 1.5407, lr_0 = 9.9652e-04
Validation auc = 0.653426
Epoch 5205
Loss = 7.6189e-02, PNorm = 661.1822, GNorm = 3.4521, lr_0 = 9.9652e-04
Validation auc = 0.655952
Epoch 5206
Loss = 6.7189e-02, PNorm = 661.2515, GNorm = 0.2844, lr_0 = 9.9652e-04
Validation auc = 0.666861
Epoch 5207
Loss = 4.9085e-02, PNorm = 661.3123, GNorm = 1.9704, lr_0 = 9.9652e-04
Validation auc = 0.659217
Epoch 5208
Loss = 1.4061e-02, PNorm = 661.3689, GNorm = 0.9943, lr_0 = 9.9652e-04
Validation auc = 0.657499
Epoch 5209
Loss = 2.0515e-02, PNorm = 661.4174, GNorm = 1.1140, lr_0 = 9.9652e-04
Loss = 4.6748e-02, PNorm = 661.4667, GNorm = 0.1485, lr_0 = 9.9652e-04
Validation auc = 0.668878
Epoch 5210
Loss = 2.3714e-02, PNorm = 661.5158, GNorm = 0.3284, lr_0 = 9.9652e-04
Validation auc = 0.678180
Epoch 5211
Loss = 8.0005e-02, PNorm = 661.5528, GNorm = 17.5978, lr_0 = 9.9652e-04
Validation auc = 0.683423
Epoch 5212
Loss = 4.5446e-02, PNorm = 661.6083, GNorm = 2.3293, lr_0 = 9.9652e-04
Validation auc = 0.680240
Epoch 5213
Loss = 4.6063e-02, PNorm = 661.6760, GNorm = 0.9446, lr_0 = 9.9652e-04
Validation auc = 0.691253
Epoch 5214
Loss = 6.5062e-02, PNorm = 661.7453, GNorm = 3.3196, lr_0 = 9.9652e-04
Validation auc = 0.692279
Epoch 5215
Loss = 2.5518e-02, PNorm = 661.7989, GNorm = 1.5645, lr_0 = 9.9652e-04
Validation auc = 0.689945
Epoch 5216
Loss = 2.6516e-02, PNorm = 661.8582, GNorm = 0.3072, lr_0 = 9.9652e-04
Validation auc = 0.690891
Epoch 5217
Loss = 1.8932e-02, PNorm = 661.9071, GNorm = 0.2089, lr_0 = 9.9652e-04
Validation auc = 0.695144
Epoch 5218
Loss = 1.0530e-02, PNorm = 661.9431, GNorm = 1.1216, lr_0 = 9.9651e-04
Validation auc = 0.694175
Epoch 5219
Loss = 1.0415e-01, PNorm = 662.0132, GNorm = 11.3927, lr_0 = 9.9651e-04
Loss = 8.1972e-02, PNorm = 662.1314, GNorm = 0.8251, lr_0 = 9.9651e-04
Validation auc = 0.706592
Epoch 5220
Loss = 2.4130e-01, PNorm = 662.2750, GNorm = 1.0209, lr_0 = 9.9651e-04
Validation auc = 0.706374
Epoch 5221
Loss = 1.4464e-01, PNorm = 662.4212, GNorm = 1.1227, lr_0 = 9.9651e-04
Validation auc = 0.706506
Epoch 5222
Loss = 1.6968e-01, PNorm = 662.5428, GNorm = 4.0565, lr_0 = 9.9651e-04
Validation auc = 0.704882
Epoch 5223
Loss = 7.7508e-02, PNorm = 662.6795, GNorm = 2.3048, lr_0 = 9.9651e-04
Validation auc = 0.695109
Epoch 5224
Loss = 1.0300e-01, PNorm = 662.7811, GNorm = 5.7690, lr_0 = 9.9651e-04
Validation auc = 0.700791
Epoch 5225
Loss = 9.3317e-02, PNorm = 662.8800, GNorm = 4.1512, lr_0 = 9.9651e-04
Validation auc = 0.711108
Epoch 5226
Loss = 1.0801e-01, PNorm = 662.9759, GNorm = 3.4852, lr_0 = 9.9651e-04
Validation auc = 0.707856
Epoch 5227
Loss = 9.9237e-02, PNorm = 663.0578, GNorm = 0.6793, lr_0 = 9.9651e-04
Validation auc = 0.711937
Epoch 5228
Loss = 2.3303e-02, PNorm = 663.1213, GNorm = 1.7828, lr_0 = 9.9651e-04
Validation auc = 0.713632
Epoch 5229
Loss = 1.1374e-01, PNorm = 663.1743, GNorm = 4.8370, lr_0 = 9.9651e-04
Loss = 3.3167e-02, PNorm = 663.2303, GNorm = 0.8005, lr_0 = 9.9651e-04
Validation auc = 0.710697
Epoch 5230
Loss = 7.7595e-02, PNorm = 663.2884, GNorm = 0.9292, lr_0 = 9.9651e-04
Validation auc = 0.715057
Epoch 5231
Loss = 5.2331e-02, PNorm = 663.3530, GNorm = 1.9091, lr_0 = 9.9650e-04
Validation auc = 0.709877
Epoch 5232
Loss = 7.7351e-02, PNorm = 663.4213, GNorm = 1.6338, lr_0 = 9.9650e-04
Validation auc = 0.705959
Epoch 5233
Loss = 4.7674e-02, PNorm = 663.4830, GNorm = 0.3282, lr_0 = 9.9650e-04
Validation auc = 0.702473
Epoch 5234
Loss = 4.3876e-02, PNorm = 663.5269, GNorm = 3.6382, lr_0 = 9.9650e-04
Validation auc = 0.698790
Epoch 5235
Loss = 4.9594e-02, PNorm = 663.5696, GNorm = 1.4028, lr_0 = 9.9650e-04
Validation auc = 0.696299
Epoch 5236
Loss = 1.7956e-02, PNorm = 663.6196, GNorm = 1.2983, lr_0 = 9.9650e-04
Validation auc = 0.693936
Epoch 5237
Loss = 8.5152e-02, PNorm = 663.6826, GNorm = 5.4472, lr_0 = 9.9650e-04
Validation auc = 0.693191
Epoch 5238
Loss = 1.1746e-02, PNorm = 663.7489, GNorm = 0.5943, lr_0 = 9.9650e-04
Validation auc = 0.694758
Epoch 5239
Loss = 6.3711e-03, PNorm = 663.8016, GNorm = 0.4644, lr_0 = 9.9650e-04
Loss = 4.2666e-02, PNorm = 663.8444, GNorm = 3.0454, lr_0 = 9.9650e-04
Validation auc = 0.701222
Epoch 5240
Loss = 6.0378e-02, PNorm = 663.8907, GNorm = 5.9218, lr_0 = 9.9650e-04
Validation auc = 0.706106
Epoch 5241
Loss = 6.8246e-02, PNorm = 663.9548, GNorm = 1.1685, lr_0 = 9.9650e-04
Validation auc = 0.714137
Epoch 5242
Loss = 5.1835e-02, PNorm = 664.0132, GNorm = 4.3538, lr_0 = 9.9650e-04
Validation auc = 0.711912
Epoch 5243
Loss = 4.7236e-02, PNorm = 664.0770, GNorm = 1.7612, lr_0 = 9.9650e-04
Validation auc = 0.714541
Epoch 5244
Loss = 2.6135e-02, PNorm = 664.1358, GNorm = 0.8955, lr_0 = 9.9649e-04
Validation auc = 0.721711
Epoch 5245
Loss = 1.5303e-02, PNorm = 664.1960, GNorm = 0.7527, lr_0 = 9.9649e-04
Validation auc = 0.723934
Epoch 5246
Loss = 7.8606e-02, PNorm = 664.2558, GNorm = 2.1788, lr_0 = 9.9649e-04
Validation auc = 0.721578
Epoch 5247
Loss = 8.7333e-02, PNorm = 664.3090, GNorm = 4.7156, lr_0 = 9.9649e-04
Validation auc = 0.706760
Epoch 5248
Loss = 2.4769e-02, PNorm = 664.3719, GNorm = 0.8744, lr_0 = 9.9649e-04
Validation auc = 0.698393
Epoch 5249
Loss = 1.6544e-02, PNorm = 664.4412, GNorm = 1.2554, lr_0 = 9.9649e-04
Loss = 9.7368e-02, PNorm = 664.5191, GNorm = 3.0689, lr_0 = 9.9649e-04
Validation auc = 0.692550
Epoch 5250
Loss = 6.2268e-02, PNorm = 664.5883, GNorm = 10.3561, lr_0 = 9.9649e-04
Validation auc = 0.690745
Epoch 5251
Loss = 5.3745e-02, PNorm = 664.6484, GNorm = 1.4314, lr_0 = 9.9649e-04
Validation auc = 0.693617
Epoch 5252
Loss = 5.2164e-02, PNorm = 664.7012, GNorm = 3.4228, lr_0 = 9.9649e-04
Validation auc = 0.697104
Epoch 5253
Loss = 7.5153e-02, PNorm = 664.7602, GNorm = 1.7626, lr_0 = 9.9649e-04
Validation auc = 0.706034
Epoch 5254
Loss = 6.7765e-02, PNorm = 664.8192, GNorm = 1.0258, lr_0 = 9.9649e-04
Validation auc = 0.720209
Epoch 5255
Loss = 7.2511e-02, PNorm = 664.8756, GNorm = 4.5081, lr_0 = 9.9649e-04
Validation auc = 0.723613
Epoch 5256
Loss = 3.5360e-02, PNorm = 664.9267, GNorm = 0.7757, lr_0 = 9.9649e-04
Validation auc = 0.723757
Epoch 5257
Loss = 1.1089e-02, PNorm = 664.9798, GNorm = 0.6050, lr_0 = 9.9649e-04
Validation auc = 0.721003
Epoch 5258
Loss = 4.7314e-02, PNorm = 665.0365, GNorm = 1.0753, lr_0 = 9.9648e-04
Validation auc = 0.712539
Epoch 5259
Loss = 9.1001e-02, PNorm = 665.1132, GNorm = 3.9911, lr_0 = 9.9648e-04
Loss = 8.2926e-02, PNorm = 665.1830, GNorm = 2.1319, lr_0 = 9.9648e-04
Validation auc = 0.701455
Epoch 5260
Loss = 9.2637e-02, PNorm = 665.2609, GNorm = 0.2782, lr_0 = 9.9648e-04
Validation auc = 0.678661
Epoch 5261
Loss = 3.6796e-02, PNorm = 665.3264, GNorm = 2.2919, lr_0 = 9.9648e-04
Validation auc = 0.668911
Epoch 5262
Loss = 4.6265e-02, PNorm = 665.3767, GNorm = 1.7783, lr_0 = 9.9648e-04
Validation auc = 0.672747
Epoch 5263
Loss = 4.8972e-02, PNorm = 665.4257, GNorm = 0.9416, lr_0 = 9.9648e-04
Validation auc = 0.676525
Epoch 5264
Loss = 8.9015e-02, PNorm = 665.4740, GNorm = 4.5061, lr_0 = 9.9648e-04
Validation auc = 0.677746
Epoch 5265
Loss = 6.1514e-02, PNorm = 665.5330, GNorm = 4.7902, lr_0 = 9.9648e-04
Validation auc = 0.673052
Epoch 5266
Loss = 7.0253e-02, PNorm = 665.5935, GNorm = 3.2332, lr_0 = 9.9648e-04
Validation auc = 0.680442
Epoch 5267
Loss = 2.5996e-02, PNorm = 665.6652, GNorm = 2.7334, lr_0 = 9.9648e-04
Validation auc = 0.692203
Epoch 5268
Loss = 2.6188e-02, PNorm = 665.7556, GNorm = 2.4804, lr_0 = 9.9648e-04
Validation auc = 0.704793
Epoch 5269
Loss = 4.8418e-02, PNorm = 665.8389, GNorm = 1.9835, lr_0 = 9.9648e-04
Loss = 1.3343e-01, PNorm = 665.9256, GNorm = 7.7133, lr_0 = 9.9648e-04
Validation auc = 0.715106
Epoch 5270
Loss = 1.9445e-01, PNorm = 666.0343, GNorm = 1.2068, lr_0 = 9.9647e-04
Validation auc = 0.705889
Epoch 5271
Loss = 1.6677e-01, PNorm = 666.1765, GNorm = 3.5137, lr_0 = 9.9647e-04
Validation auc = 0.702150
Epoch 5272
Loss = 1.5644e-01, PNorm = 666.3161, GNorm = 0.9282, lr_0 = 9.9647e-04
Validation auc = 0.713294
Epoch 5273
Loss = 5.3484e-02, PNorm = 666.4260, GNorm = 2.3007, lr_0 = 9.9647e-04
Validation auc = 0.717590
Epoch 5274
Loss = 1.2373e-01, PNorm = 666.5064, GNorm = 2.9216, lr_0 = 9.9647e-04
Validation auc = 0.719507
Epoch 5275
Loss = 6.6809e-02, PNorm = 666.5732, GNorm = 4.5748, lr_0 = 9.9647e-04
Validation auc = 0.720077
Epoch 5276
Loss = 2.2936e-02, PNorm = 666.6274, GNorm = 2.0154, lr_0 = 9.9647e-04
Validation auc = 0.720946
Epoch 5277
Loss = 5.2272e-02, PNorm = 666.6772, GNorm = 0.8173, lr_0 = 9.9647e-04
Validation auc = 0.722011
Epoch 5278
Loss = 5.3432e-02, PNorm = 666.7408, GNorm = 2.4415, lr_0 = 9.9647e-04
Validation auc = 0.718570
Epoch 5279
Loss = 3.6328e-02, PNorm = 666.8120, GNorm = 1.2595, lr_0 = 9.9647e-04
Loss = 5.9857e-02, PNorm = 666.8828, GNorm = 0.4308, lr_0 = 9.9647e-04
Validation auc = 0.720946
Epoch 5280
Loss = 4.6614e-02, PNorm = 666.9365, GNorm = 1.2920, lr_0 = 9.9647e-04
Validation auc = 0.722320
Epoch 5281
Loss = 3.9891e-02, PNorm = 666.9877, GNorm = 9.7795, lr_0 = 9.9647e-04
Validation auc = 0.717348
Epoch 5282
Loss = 3.8943e-02, PNorm = 667.0385, GNorm = 1.7758, lr_0 = 9.9647e-04
Validation auc = 0.706569
Epoch 5283
Loss = 1.0730e-01, PNorm = 667.0847, GNorm = 1.7954, lr_0 = 9.9647e-04
Validation auc = 0.707074
Epoch 5284
Loss = 3.3706e-02, PNorm = 667.1338, GNorm = 0.9270, lr_0 = 9.9646e-04
Validation auc = 0.707788
Epoch 5285
Loss = 5.2923e-02, PNorm = 667.1777, GNorm = 4.7194, lr_0 = 9.9646e-04
Validation auc = 0.708059
Epoch 5286
Loss = 6.5763e-02, PNorm = 667.2265, GNorm = 5.7811, lr_0 = 9.9646e-04
Validation auc = 0.710879
Epoch 5287
Loss = 4.6826e-02, PNorm = 667.2841, GNorm = 0.3699, lr_0 = 9.9646e-04
Validation auc = 0.709098
Epoch 5288
Loss = 5.5035e-02, PNorm = 667.3441, GNorm = 0.4787, lr_0 = 9.9646e-04
Validation auc = 0.708076
Epoch 5289
Loss = 1.0469e-01, PNorm = 667.4064, GNorm = 3.0114, lr_0 = 9.9646e-04
Loss = 8.8942e-02, PNorm = 667.4727, GNorm = 1.5444, lr_0 = 9.9646e-04
Validation auc = 0.710046
Epoch 5290
Loss = 7.0847e-02, PNorm = 667.5398, GNorm = 1.1542, lr_0 = 9.9646e-04
Validation auc = 0.708249
Epoch 5291
Loss = 6.7882e-02, PNorm = 667.6179, GNorm = 0.6529, lr_0 = 9.9646e-04
Validation auc = 0.703004
Epoch 5292
Loss = 9.1931e-02, PNorm = 667.6843, GNorm = 7.8102, lr_0 = 9.9646e-04
Validation auc = 0.697032
Epoch 5293
Loss = 6.6957e-02, PNorm = 667.7492, GNorm = 1.0130, lr_0 = 9.9646e-04
Validation auc = 0.702493
Epoch 5294
Loss = 1.2192e-01, PNorm = 667.8185, GNorm = 2.1970, lr_0 = 9.9646e-04
Validation auc = 0.709221
Epoch 5295
Loss = 6.7561e-02, PNorm = 667.8953, GNorm = 2.0767, lr_0 = 9.9646e-04
Validation auc = 0.704348
Epoch 5296
Loss = 7.4911e-02, PNorm = 667.9623, GNorm = 0.6854, lr_0 = 9.9646e-04
Validation auc = 0.702146
Epoch 5297
Loss = 8.2606e-02, PNorm = 668.0213, GNorm = 1.3023, lr_0 = 9.9645e-04
Validation auc = 0.698374
Epoch 5298
Loss = 5.6161e-02, PNorm = 668.0719, GNorm = 0.4446, lr_0 = 9.9645e-04
Validation auc = 0.696417
Epoch 5299
Loss = 1.5191e-02, PNorm = 668.1144, GNorm = 0.8489, lr_0 = 9.9645e-04
Loss = 6.1814e-02, PNorm = 668.1509, GNorm = 1.6207, lr_0 = 9.9645e-04
Validation auc = 0.693464
Epoch 5300
Loss = 5.9212e-02, PNorm = 668.1937, GNorm = 0.8640, lr_0 = 9.9645e-04
Validation auc = 0.693618
Epoch 5301
Loss = 3.4165e-02, PNorm = 668.2350, GNorm = 1.0352, lr_0 = 9.9645e-04
Validation auc = 0.694914
Epoch 5302
Loss = 5.0654e-02, PNorm = 668.2752, GNorm = 0.4714, lr_0 = 9.9645e-04
Validation auc = 0.703261
Epoch 5303
Loss = 1.4498e-02, PNorm = 668.3279, GNorm = 0.3413, lr_0 = 9.9645e-04
Validation auc = 0.707304
Epoch 5304
Loss = 2.2137e-02, PNorm = 668.3722, GNorm = 0.4428, lr_0 = 9.9645e-04
Validation auc = 0.710335
Epoch 5305
Loss = 2.8578e-02, PNorm = 668.4024, GNorm = 1.2459, lr_0 = 9.9645e-04
Validation auc = 0.706804
Epoch 5306
Loss = 2.0126e-02, PNorm = 668.4297, GNorm = 1.1085, lr_0 = 9.9645e-04
Validation auc = 0.703658
Epoch 5307
Loss = 8.5748e-02, PNorm = 668.4573, GNorm = 0.5796, lr_0 = 9.9645e-04
Validation auc = 0.703308
Epoch 5308
Loss = 5.9036e-02, PNorm = 668.4970, GNorm = 4.1291, lr_0 = 9.9645e-04
Validation auc = 0.695350
Epoch 5309
Loss = 1.5209e-01, PNorm = 668.5444, GNorm = 3.1301, lr_0 = 9.9645e-04
Loss = 3.6277e-02, PNorm = 668.5791, GNorm = 3.2516, lr_0 = 9.9645e-04
Validation auc = 0.689522
Epoch 5310
Loss = 9.7553e-02, PNorm = 668.6214, GNorm = 9.3870, lr_0 = 9.9644e-04
Validation auc = 0.689636
Epoch 5311
Loss = 1.0570e-01, PNorm = 668.6705, GNorm = 25.4087, lr_0 = 9.9644e-04
Validation auc = 0.691691
Epoch 5312
Loss = 1.9441e-02, PNorm = 668.7298, GNorm = 0.4485, lr_0 = 9.9644e-04
Validation auc = 0.692584
Epoch 5313
Loss = 7.0456e-02, PNorm = 668.7755, GNorm = 0.4731, lr_0 = 9.9644e-04
Validation auc = 0.685626
Epoch 5314
Loss = 3.7908e-02, PNorm = 668.8156, GNorm = 2.1677, lr_0 = 9.9644e-04
Validation auc = 0.684845
Epoch 5315
Loss = 9.0809e-02, PNorm = 668.8493, GNorm = 2.3636, lr_0 = 9.9644e-04
Validation auc = 0.687858
Epoch 5316
Loss = 5.5139e-02, PNorm = 668.9005, GNorm = 0.2895, lr_0 = 9.9644e-04
Validation auc = 0.692711
Epoch 5317
Loss = 1.7845e-02, PNorm = 668.9523, GNorm = 0.1975, lr_0 = 9.9644e-04
Validation auc = 0.694308
Epoch 5318
Loss = 4.0950e-03, PNorm = 669.0044, GNorm = 0.1679, lr_0 = 9.9644e-04
Validation auc = 0.694140
Epoch 5319
Loss = 6.6800e-03, PNorm = 669.0473, GNorm = 0.5571, lr_0 = 9.9644e-04
Loss = 7.1234e-02, PNorm = 669.0891, GNorm = 1.2402, lr_0 = 9.9644e-04
Validation auc = 0.693910
Epoch 5320
Loss = 4.1565e-02, PNorm = 669.1521, GNorm = 0.3815, lr_0 = 9.9644e-04
Validation auc = 0.696072
Epoch 5321
Loss = 5.2222e-02, PNorm = 669.2055, GNorm = 1.5522, lr_0 = 9.9644e-04
Validation auc = 0.699261
Epoch 5322
Loss = 3.0249e-02, PNorm = 669.2530, GNorm = 3.4379, lr_0 = 9.9644e-04
Validation auc = 0.699866
Epoch 5323
Loss = 4.5388e-02, PNorm = 669.2906, GNorm = 3.2553, lr_0 = 9.9644e-04
Validation auc = 0.697716
Epoch 5324
Loss = 2.8621e-02, PNorm = 669.3261, GNorm = 1.6634, lr_0 = 9.9643e-04
Validation auc = 0.697773
Epoch 5325
Loss = 2.6403e-02, PNorm = 669.3634, GNorm = 2.5659, lr_0 = 9.9643e-04
Validation auc = 0.698209
Epoch 5326
Loss = 5.0450e-02, PNorm = 669.4045, GNorm = 3.4583, lr_0 = 9.9643e-04
Validation auc = 0.700277
Epoch 5327
Loss = 4.4553e-03, PNorm = 669.4493, GNorm = 0.1880, lr_0 = 9.9643e-04
Validation auc = 0.700371
Epoch 5328
Loss = 2.3106e-02, PNorm = 669.4854, GNorm = 2.1743, lr_0 = 9.9643e-04
Validation auc = 0.698075
Epoch 5329
Loss = 3.5698e-02, PNorm = 669.5268, GNorm = 4.1284, lr_0 = 9.9643e-04
Loss = 1.0370e-01, PNorm = 669.5741, GNorm = 7.7492, lr_0 = 9.9643e-04
Validation auc = 0.697826
Epoch 5330
Loss = 3.5315e-02, PNorm = 669.6354, GNorm = 4.4618, lr_0 = 9.9643e-04
Validation auc = 0.686274
Epoch 5331
Loss = 5.1229e-02, PNorm = 669.6863, GNorm = 12.0124, lr_0 = 9.9643e-04
Validation auc = 0.684875
Epoch 5332
Loss = 5.2764e-02, PNorm = 669.7381, GNorm = 1.7912, lr_0 = 9.9643e-04
Validation auc = 0.685042
Epoch 5333
Loss = 4.6295e-02, PNorm = 669.7894, GNorm = 0.7081, lr_0 = 9.9643e-04
Validation auc = 0.683753
Epoch 5334
Loss = 3.4540e-02, PNorm = 669.8370, GNorm = 0.3990, lr_0 = 9.9643e-04
Validation auc = 0.683834
Epoch 5335
Loss = 7.0922e-02, PNorm = 669.8826, GNorm = 8.3527, lr_0 = 9.9643e-04
Validation auc = 0.682480
Epoch 5336
Loss = 3.2729e-02, PNorm = 669.9333, GNorm = 1.5854, lr_0 = 9.9643e-04
Validation auc = 0.685788
Epoch 5337
Loss = 7.2162e-02, PNorm = 669.9737, GNorm = 0.8954, lr_0 = 9.9642e-04
Validation auc = 0.693525
Epoch 5338
Loss = 5.3025e-02, PNorm = 670.0058, GNorm = 1.4118, lr_0 = 9.9642e-04
Validation auc = 0.693370
Epoch 5339
Loss = 3.8143e-03, PNorm = 670.0404, GNorm = 0.2356, lr_0 = 9.9642e-04
Loss = 6.0820e-02, PNorm = 670.0810, GNorm = 2.7813, lr_0 = 9.9642e-04
Validation auc = 0.689767
Epoch 5340
Loss = 4.4122e-02, PNorm = 670.1197, GNorm = 1.5866, lr_0 = 9.9642e-04
Validation auc = 0.689254
Epoch 5341
Loss = 6.0461e-02, PNorm = 670.1598, GNorm = 1.6556, lr_0 = 9.9642e-04
Validation auc = 0.683751
Epoch 5342
Loss = 3.4133e-02, PNorm = 670.1929, GNorm = 2.3569, lr_0 = 9.9642e-04
Validation auc = 0.680719
Epoch 5343
Loss = 2.2746e-02, PNorm = 670.2275, GNorm = 0.4275, lr_0 = 9.9642e-04
Validation auc = 0.676564
Epoch 5344
Loss = 5.7241e-02, PNorm = 670.2605, GNorm = 0.9216, lr_0 = 9.9642e-04
Validation auc = 0.666617
Epoch 5345
Loss = 2.7171e-02, PNorm = 670.3095, GNorm = 3.5109, lr_0 = 9.9642e-04
Validation auc = 0.673155
Epoch 5346
Loss = 1.4522e-02, PNorm = 670.3756, GNorm = 0.2153, lr_0 = 9.9642e-04
Validation auc = 0.680633
Epoch 5347
Loss = 4.7206e-02, PNorm = 670.4285, GNorm = 2.2655, lr_0 = 9.9642e-04
Validation auc = 0.683914
Epoch 5348
Loss = 9.4098e-02, PNorm = 670.4708, GNorm = 4.3939, lr_0 = 9.9642e-04
Validation auc = 0.679838
Epoch 5349
Loss = 1.5920e-02, PNorm = 670.5078, GNorm = 0.9311, lr_0 = 9.9642e-04
Loss = 4.9519e-02, PNorm = 670.5458, GNorm = 0.7858, lr_0 = 9.9642e-04
Validation auc = 0.677584
Epoch 5350
Loss = 6.1054e-02, PNorm = 670.5872, GNorm = 1.8799, lr_0 = 9.9641e-04
Validation auc = 0.678511
Epoch 5351
Loss = 4.5388e-02, PNorm = 670.6311, GNorm = 1.3289, lr_0 = 9.9641e-04
Validation auc = 0.683010
Epoch 5352
Loss = 1.7752e-02, PNorm = 670.6686, GNorm = 0.2735, lr_0 = 9.9641e-04
Validation auc = 0.684234
Epoch 5353
Loss = 2.3273e-02, PNorm = 670.7004, GNorm = 1.9410, lr_0 = 9.9641e-04
Validation auc = 0.682686
Epoch 5354
Loss = 2.2725e-02, PNorm = 670.7238, GNorm = 0.6542, lr_0 = 9.9641e-04
Validation auc = 0.682323
Epoch 5355
Loss = 8.1564e-02, PNorm = 670.7465, GNorm = 6.5891, lr_0 = 9.9641e-04
Validation auc = 0.684252
Epoch 5356
Loss = 1.9428e-02, PNorm = 670.7746, GNorm = 1.2869, lr_0 = 9.9641e-04
Validation auc = 0.684610
Epoch 5357
Loss = 2.2026e-02, PNorm = 670.8160, GNorm = 4.3554, lr_0 = 9.9641e-04
Validation auc = 0.680090
Epoch 5358
Loss = 5.1547e-02, PNorm = 670.8810, GNorm = 3.8734, lr_0 = 9.9641e-04
Validation auc = 0.679172
Epoch 5359
Loss = 2.3503e-02, PNorm = 670.9362, GNorm = 1.1912, lr_0 = 9.9641e-04
Loss = 7.1439e-02, PNorm = 670.9807, GNorm = 6.2464, lr_0 = 9.9641e-04
Validation auc = 0.677008
Epoch 5360
Loss = 7.5222e-02, PNorm = 671.0367, GNorm = 2.1103, lr_0 = 9.9641e-04
Validation auc = 0.675236
Epoch 5361
Loss = 1.5964e-02, PNorm = 671.0859, GNorm = 0.7821, lr_0 = 9.9641e-04
Validation auc = 0.679681
Epoch 5362
Loss = 3.7723e-02, PNorm = 671.1293, GNorm = 2.3600, lr_0 = 9.9641e-04
Validation auc = 0.685976
Epoch 5363
Loss = 3.1177e-02, PNorm = 671.1647, GNorm = 1.7193, lr_0 = 9.9640e-04
Validation auc = 0.681737
Epoch 5364
Loss = 3.3616e-02, PNorm = 671.1963, GNorm = 0.1308, lr_0 = 9.9640e-04
Validation auc = 0.681913
Epoch 5365
Loss = 1.1968e-02, PNorm = 671.2268, GNorm = 2.1962, lr_0 = 9.9640e-04
Validation auc = 0.687748
Epoch 5366
Loss = 4.4785e-02, PNorm = 671.2609, GNorm = 3.6214, lr_0 = 9.9640e-04
Validation auc = 0.683774
Epoch 5367
Loss = 6.1162e-02, PNorm = 671.3094, GNorm = 1.0284, lr_0 = 9.9640e-04
Validation auc = 0.679520
Epoch 5368
Loss = 3.7906e-02, PNorm = 671.3604, GNorm = 3.6871, lr_0 = 9.9640e-04
Validation auc = 0.679469
Epoch 5369
Loss = 9.8495e-02, PNorm = 671.4102, GNorm = 4.2331, lr_0 = 9.9640e-04
Loss = 2.9586e-02, PNorm = 671.4528, GNorm = 1.0153, lr_0 = 9.9640e-04
Validation auc = 0.681289
Epoch 5370
Loss = 5.3253e-02, PNorm = 671.4922, GNorm = 0.2330, lr_0 = 9.9640e-04
Validation auc = 0.684653
Epoch 5371
Loss = 2.7644e-02, PNorm = 671.5373, GNorm = 2.3913, lr_0 = 9.9640e-04
Validation auc = 0.688557
Epoch 5372
Loss = 7.0478e-02, PNorm = 671.6068, GNorm = 0.3279, lr_0 = 9.9640e-04
Validation auc = 0.703177
Epoch 5373
Loss = 4.3835e-02, PNorm = 671.6756, GNorm = 0.7249, lr_0 = 9.9640e-04
Validation auc = 0.717172
Epoch 5374
Loss = 3.3785e-02, PNorm = 671.7381, GNorm = 0.2712, lr_0 = 9.9640e-04
Validation auc = 0.720118
Epoch 5375
Loss = 4.6087e-02, PNorm = 671.7899, GNorm = 3.2780, lr_0 = 9.9640e-04
Validation auc = 0.721203
Epoch 5376
Loss = 2.8170e-02, PNorm = 671.8349, GNorm = 0.5235, lr_0 = 9.9640e-04
Validation auc = 0.718713
Epoch 5377
Loss = 1.4174e-02, PNorm = 671.8724, GNorm = 0.7856, lr_0 = 9.9639e-04
Validation auc = 0.716256
Epoch 5378
Loss = 4.3982e-02, PNorm = 671.9081, GNorm = 3.8227, lr_0 = 9.9639e-04
Validation auc = 0.714662
Epoch 5379
Loss = 2.5965e-02, PNorm = 671.9468, GNorm = 0.6749, lr_0 = 9.9639e-04
Loss = 4.4443e-02, PNorm = 671.9798, GNorm = 0.4870, lr_0 = 9.9639e-04
Validation auc = 0.721768
Epoch 5380
Loss = 4.4940e-02, PNorm = 672.0129, GNorm = 0.4103, lr_0 = 9.9639e-04
Validation auc = 0.721082
Epoch 5381
Loss = 1.8080e-02, PNorm = 672.0401, GNorm = 0.3808, lr_0 = 9.9639e-04
Validation auc = 0.717851
Epoch 5382
Loss = 5.1231e-02, PNorm = 672.0705, GNorm = 1.7307, lr_0 = 9.9639e-04
Validation auc = 0.707768
Epoch 5383
Loss = 2.2548e-02, PNorm = 672.1026, GNorm = 0.6295, lr_0 = 9.9639e-04
Validation auc = 0.704357
Epoch 5384
Loss = 2.4477e-02, PNorm = 672.1395, GNorm = 2.5367, lr_0 = 9.9639e-04
Validation auc = 0.704160
Epoch 5385
Loss = 5.2423e-02, PNorm = 672.1753, GNorm = 3.2213, lr_0 = 9.9639e-04
Validation auc = 0.700880
Epoch 5386
Loss = 1.7931e-01, PNorm = 672.2159, GNorm = 0.4719, lr_0 = 9.9639e-04
Validation auc = 0.701633
Epoch 5387
Loss = 8.5531e-02, PNorm = 672.2808, GNorm = 5.0903, lr_0 = 9.9639e-04
Validation auc = 0.705894
Epoch 5388
Loss = 7.2156e-03, PNorm = 672.3527, GNorm = 0.6329, lr_0 = 9.9639e-04
Validation auc = 0.702131
Epoch 5389
Loss = 6.7172e-02, PNorm = 672.4189, GNorm = 9.0243, lr_0 = 9.9639e-04
Loss = 2.2455e-02, PNorm = 672.4822, GNorm = 1.9027, lr_0 = 9.9638e-04
Validation auc = 0.701231
Epoch 5390
Loss = 8.5631e-02, PNorm = 672.5403, GNorm = 1.6984, lr_0 = 9.9638e-04
Validation auc = 0.700550
Epoch 5391
Loss = 3.6896e-02, PNorm = 672.6028, GNorm = 1.1720, lr_0 = 9.9638e-04
Validation auc = 0.699545
Epoch 5392
Loss = 3.1036e-02, PNorm = 672.6615, GNorm = 2.4962, lr_0 = 9.9638e-04
Validation auc = 0.702056
Epoch 5393
Loss = 1.7648e-01, PNorm = 672.7093, GNorm = 19.9618, lr_0 = 9.9638e-04
Validation auc = 0.705543
Epoch 5394
Loss = 7.4303e-02, PNorm = 672.7734, GNorm = 3.5207, lr_0 = 9.9638e-04
Validation auc = 0.700328
Epoch 5395
Loss = 6.9099e-02, PNorm = 672.8436, GNorm = 1.6833, lr_0 = 9.9638e-04
Validation auc = 0.687061
Epoch 5396
Loss = 9.7789e-02, PNorm = 672.9055, GNorm = 0.7085, lr_0 = 9.9638e-04
Validation auc = 0.684411
Epoch 5397
Loss = 4.3359e-02, PNorm = 672.9636, GNorm = 1.9230, lr_0 = 9.9638e-04
Validation auc = 0.690875
Epoch 5398
Loss = 3.9756e-02, PNorm = 673.0197, GNorm = 2.3926, lr_0 = 9.9638e-04
Validation auc = 0.694308
Epoch 5399
Loss = 3.2929e-02, PNorm = 673.0637, GNorm = 3.1555, lr_0 = 9.9638e-04
Loss = 3.1415e-02, PNorm = 673.1103, GNorm = 1.1409, lr_0 = 9.9638e-04
Validation auc = 0.699935
Epoch 5400
Loss = 2.7264e-02, PNorm = 673.1480, GNorm = 2.1452, lr_0 = 9.9638e-04
Validation auc = 0.706370
Epoch 5401
Loss = 2.8667e-02, PNorm = 673.1950, GNorm = 2.3723, lr_0 = 9.9638e-04
Validation auc = 0.707269
Epoch 5402
Loss = 6.4311e-02, PNorm = 673.2336, GNorm = 0.6902, lr_0 = 9.9638e-04
Validation auc = 0.709935
Epoch 5403
Loss = 1.1630e-01, PNorm = 673.2705, GNorm = 5.4865, lr_0 = 9.9637e-04
Validation auc = 0.713908
Epoch 5404
Loss = 4.1195e-02, PNorm = 673.3075, GNorm = 4.9641, lr_0 = 9.9637e-04
Validation auc = 0.712179
Epoch 5405
Loss = 6.3202e-02, PNorm = 673.3560, GNorm = 2.3600, lr_0 = 9.9637e-04
Validation auc = 0.705730
Epoch 5406
Loss = 3.6451e-02, PNorm = 673.3991, GNorm = 1.9755, lr_0 = 9.9637e-04
Validation auc = 0.708205
Epoch 5407
Loss = 3.4466e-02, PNorm = 673.4349, GNorm = 1.6133, lr_0 = 9.9637e-04
Validation auc = 0.715101
Epoch 5408
Loss = 3.2878e-02, PNorm = 673.4672, GNorm = 1.2874, lr_0 = 9.9637e-04
Validation auc = 0.722602
Epoch 5409
Loss = 1.0281e-02, PNorm = 673.5043, GNorm = 0.7046, lr_0 = 9.9637e-04
Loss = 4.2416e-02, PNorm = 673.5332, GNorm = 0.8190, lr_0 = 9.9637e-04
Validation auc = 0.722341
Epoch 5410
Loss = 4.5533e-02, PNorm = 673.5642, GNorm = 0.4943, lr_0 = 9.9637e-04
Validation auc = 0.719256
Epoch 5411
Loss = 9.0806e-02, PNorm = 673.5984, GNorm = 3.4357, lr_0 = 9.9637e-04
Validation auc = 0.715708
Epoch 5412
Loss = 5.2757e-02, PNorm = 673.6464, GNorm = 3.3019, lr_0 = 9.9637e-04
Validation auc = 0.717581
Epoch 5413
Loss = 4.7014e-02, PNorm = 673.6965, GNorm = 2.3019, lr_0 = 9.9637e-04
Validation auc = 0.725407
Epoch 5414
Loss = 2.3185e-02, PNorm = 673.7474, GNorm = 1.5694, lr_0 = 9.9637e-04
Validation auc = 0.726630
Epoch 5415
Loss = 7.7302e-02, PNorm = 673.7914, GNorm = 3.0052, lr_0 = 9.9637e-04
Validation auc = 0.725980
Epoch 5416
Loss = 9.5795e-02, PNorm = 673.8318, GNorm = 2.4890, lr_0 = 9.9637e-04
Validation auc = 0.720332
Epoch 5417
Loss = 1.7948e-02, PNorm = 673.8771, GNorm = 1.2861, lr_0 = 9.9636e-04
Validation auc = 0.713310
Epoch 5418
Loss = 9.2421e-03, PNorm = 673.9207, GNorm = 0.2923, lr_0 = 9.9636e-04
Validation auc = 0.705580
Epoch 5419
Loss = 1.9928e-02, PNorm = 673.9623, GNorm = 0.9606, lr_0 = 9.9636e-04
Loss = 2.2165e-02, PNorm = 673.9957, GNorm = 0.0905, lr_0 = 9.9636e-04
Validation auc = 0.703136
Epoch 5420
Loss = 1.9244e-02, PNorm = 674.0192, GNorm = 0.4441, lr_0 = 9.9636e-04
Validation auc = 0.701015
Epoch 5421
Loss = 4.8414e-02, PNorm = 674.0517, GNorm = 4.3416, lr_0 = 9.9636e-04
Validation auc = 0.703213
Epoch 5422
Loss = 6.2492e-02, PNorm = 674.0973, GNorm = 5.4870, lr_0 = 9.9636e-04
Validation auc = 0.700265
Epoch 5423
Loss = 9.1208e-02, PNorm = 674.1590, GNorm = 0.2885, lr_0 = 9.9636e-04
Validation auc = 0.699368
Epoch 5424
Loss = 1.6144e-02, PNorm = 674.2230, GNorm = 0.9687, lr_0 = 9.9636e-04
Validation auc = 0.695605
Epoch 5425
Loss = 4.0926e-02, PNorm = 674.2714, GNorm = 0.8871, lr_0 = 9.9636e-04
Validation auc = 0.696402
Epoch 5426
Loss = 5.4422e-02, PNorm = 674.3198, GNorm = 2.7190, lr_0 = 9.9636e-04
Validation auc = 0.693127
Epoch 5427
Loss = 1.1457e-01, PNorm = 674.3651, GNorm = 7.7397, lr_0 = 9.9636e-04
Validation auc = 0.690251
Epoch 5428
Loss = 1.1353e-01, PNorm = 674.4164, GNorm = 14.8200, lr_0 = 9.9636e-04
Validation auc = 0.688123
Epoch 5429
Loss = 1.1108e-01, PNorm = 674.4778, GNorm = 3.6643, lr_0 = 9.9636e-04
Loss = 3.4627e-02, PNorm = 674.5277, GNorm = 2.2235, lr_0 = 9.9635e-04
Validation auc = 0.691376
Epoch 5430
Loss = 3.6038e-02, PNorm = 674.5668, GNorm = 1.8672, lr_0 = 9.9635e-04
Validation auc = 0.691795
Epoch 5431
Loss = 7.4809e-02, PNorm = 674.6118, GNorm = 2.4191, lr_0 = 9.9635e-04
Validation auc = 0.692816
Epoch 5432
Loss = 4.8247e-02, PNorm = 674.6663, GNorm = 0.7912, lr_0 = 9.9635e-04
Validation auc = 0.691862
Epoch 5433
Loss = 5.6393e-02, PNorm = 674.7208, GNorm = 0.8295, lr_0 = 9.9635e-04
Validation auc = 0.690609
Epoch 5434
Loss = 3.2212e-02, PNorm = 674.7693, GNorm = 0.3430, lr_0 = 9.9635e-04
Validation auc = 0.686461
Epoch 5435
Loss = 1.5225e-02, PNorm = 674.8059, GNorm = 0.3151, lr_0 = 9.9635e-04
Validation auc = 0.686092
Epoch 5436
Loss = 5.9060e-02, PNorm = 674.8414, GNorm = 1.0863, lr_0 = 9.9635e-04
Validation auc = 0.682500
Epoch 5437
Loss = 2.7322e-02, PNorm = 674.8943, GNorm = 0.6270, lr_0 = 9.9635e-04
Validation auc = 0.678548
Epoch 5438
Loss = 2.1606e-02, PNorm = 674.9525, GNorm = 1.1155, lr_0 = 9.9635e-04
Validation auc = 0.679600
Epoch 5439
Loss = 1.0229e-01, PNorm = 674.9940, GNorm = 3.5239, lr_0 = 9.9635e-04
Loss = 6.0700e-02, PNorm = 675.0264, GNorm = 18.1843, lr_0 = 9.9635e-04
Validation auc = 0.679614
Epoch 5440
Loss = 4.7795e-02, PNorm = 675.0757, GNorm = 6.7191, lr_0 = 9.9635e-04
Validation auc = 0.674960
Epoch 5441
Loss = 6.4593e-02, PNorm = 675.1273, GNorm = 0.4807, lr_0 = 9.9635e-04
Validation auc = 0.679716
Epoch 5442
Loss = 9.6730e-02, PNorm = 675.1818, GNorm = 5.0152, lr_0 = 9.9635e-04
Validation auc = 0.687313
Epoch 5443
Loss = 5.3266e-02, PNorm = 675.2366, GNorm = 0.7452, lr_0 = 9.9634e-04
Validation auc = 0.686777
Epoch 5444
Loss = 1.1346e-01, PNorm = 675.2902, GNorm = 5.4763, lr_0 = 9.9634e-04
Validation auc = 0.693414
Epoch 5445
Loss = 4.2031e-02, PNorm = 675.3530, GNorm = 0.9019, lr_0 = 9.9634e-04
Validation auc = 0.693798
Epoch 5446
Loss = 6.4891e-02, PNorm = 675.4032, GNorm = 5.2280, lr_0 = 9.9634e-04
Validation auc = 0.695126
Epoch 5447
Loss = 9.6740e-02, PNorm = 675.4482, GNorm = 7.4179, lr_0 = 9.9634e-04
Validation auc = 0.695979
Epoch 5448
Loss = 3.9256e-02, PNorm = 675.4915, GNorm = 1.8952, lr_0 = 9.9634e-04
Validation auc = 0.691804
Epoch 5449
Loss = 1.4794e-02, PNorm = 675.5673, GNorm = 1.2014, lr_0 = 9.9634e-04
Loss = 3.4989e-02, PNorm = 675.6366, GNorm = 1.7765, lr_0 = 9.9634e-04
Validation auc = 0.687349
Epoch 5450
Loss = 5.5448e-02, PNorm = 675.6867, GNorm = 2.0192, lr_0 = 9.9634e-04
Validation auc = 0.684526
Epoch 5451
Loss = 9.5372e-02, PNorm = 675.7417, GNorm = 1.1353, lr_0 = 9.9634e-04
Validation auc = 0.689925
Epoch 5452
Loss = 4.5328e-02, PNorm = 675.7993, GNorm = 2.4230, lr_0 = 9.9634e-04
Validation auc = 0.693280
Epoch 5453
Loss = 6.0316e-02, PNorm = 675.8505, GNorm = 2.1179, lr_0 = 9.9634e-04
Validation auc = 0.696240
Epoch 5454
Loss = 5.1115e-02, PNorm = 675.9039, GNorm = 2.4511, lr_0 = 9.9634e-04
Validation auc = 0.695072
Epoch 5455
Loss = 3.2997e-02, PNorm = 675.9514, GNorm = 1.8724, lr_0 = 9.9634e-04
Validation auc = 0.691638
Epoch 5456
Loss = 5.3217e-02, PNorm = 675.9944, GNorm = 0.4518, lr_0 = 9.9633e-04
Validation auc = 0.690875
Epoch 5457
Loss = 2.0646e-02, PNorm = 676.0321, GNorm = 1.2598, lr_0 = 9.9633e-04
Validation auc = 0.688819
Epoch 5458
Loss = 2.9178e-03, PNorm = 676.0669, GNorm = 0.2430, lr_0 = 9.9633e-04
Validation auc = 0.688426
Epoch 5459
Loss = 7.0415e-03, PNorm = 676.0997, GNorm = 0.2879, lr_0 = 9.9633e-04
Loss = 2.3829e-02, PNorm = 676.1332, GNorm = 1.0267, lr_0 = 9.9633e-04
Validation auc = 0.691641
Epoch 5460
Loss = 4.0791e-02, PNorm = 676.1665, GNorm = 3.7164, lr_0 = 9.9633e-04
Validation auc = 0.699178
Epoch 5461
Loss = 2.5907e-02, PNorm = 676.2089, GNorm = 0.3670, lr_0 = 9.9633e-04
Validation auc = 0.699948
Epoch 5462
Loss = 3.8091e-02, PNorm = 676.2488, GNorm = 1.2488, lr_0 = 9.9633e-04
Validation auc = 0.695228
Epoch 5463
Loss = 2.1748e-02, PNorm = 676.2935, GNorm = 3.0771, lr_0 = 9.9633e-04
Validation auc = 0.694078
Epoch 5464
Loss = 5.6623e-02, PNorm = 676.3290, GNorm = 2.6021, lr_0 = 9.9633e-04
Validation auc = 0.694962
Epoch 5465
Loss = 1.8868e-01, PNorm = 676.3738, GNorm = 3.8611, lr_0 = 9.9633e-04
Validation auc = 0.693846
Epoch 5466
Loss = 1.3370e-02, PNorm = 676.4384, GNorm = 1.1135, lr_0 = 9.9633e-04
Validation auc = 0.694896
Epoch 5467
Loss = 6.5328e-02, PNorm = 676.4924, GNorm = 2.3450, lr_0 = 9.9633e-04
Validation auc = 0.697586
Epoch 5468
Loss = 2.4967e-02, PNorm = 676.5417, GNorm = 0.4060, lr_0 = 9.9633e-04
Validation auc = 0.702843
Epoch 5469
Loss = 5.9825e-02, PNorm = 676.6018, GNorm = 3.8227, lr_0 = 9.9633e-04
Loss = 2.2978e-02, PNorm = 676.6645, GNorm = 0.5454, lr_0 = 9.9632e-04
Validation auc = 0.704883
Epoch 5470
Loss = 6.9105e-02, PNorm = 676.7312, GNorm = 6.2189, lr_0 = 9.9632e-04
Validation auc = 0.706505
Epoch 5471
Loss = 5.1150e-02, PNorm = 676.8095, GNorm = 11.6294, lr_0 = 9.9632e-04
Validation auc = 0.703964
Epoch 5472
Loss = 8.8792e-02, PNorm = 676.8972, GNorm = 2.5900, lr_0 = 9.9632e-04
Validation auc = 0.697712
Epoch 5473
Loss = 2.0384e-02, PNorm = 676.9821, GNorm = 3.0113, lr_0 = 9.9632e-04
Validation auc = 0.685617
Epoch 5474
Loss = 7.7282e-02, PNorm = 677.0560, GNorm = 0.6086, lr_0 = 9.9632e-04
Validation auc = 0.687289
Epoch 5475
Loss = 5.0684e-02, PNorm = 677.1295, GNorm = 2.8731, lr_0 = 9.9632e-04
Validation auc = 0.695466
Epoch 5476
Loss = 4.1292e-02, PNorm = 677.1784, GNorm = 2.4853, lr_0 = 9.9632e-04
Validation auc = 0.696680
Epoch 5477
Loss = 6.1626e-02, PNorm = 677.2266, GNorm = 3.1228, lr_0 = 9.9632e-04
Validation auc = 0.697242
Epoch 5478
Loss = 3.3645e-02, PNorm = 677.2736, GNorm = 1.3021, lr_0 = 9.9632e-04
Validation auc = 0.695306
Epoch 5479
Loss = 3.4748e-02, PNorm = 677.3236, GNorm = 1.3310, lr_0 = 9.9632e-04
Loss = 4.0410e-02, PNorm = 677.3638, GNorm = 0.4188, lr_0 = 9.9632e-04
Validation auc = 0.693155
Epoch 5480
Loss = 6.8121e-02, PNorm = 677.4028, GNorm = 0.8972, lr_0 = 9.9632e-04
Validation auc = 0.690681
Epoch 5481
Loss = 2.6970e-02, PNorm = 677.4470, GNorm = 0.1307, lr_0 = 9.9632e-04
Validation auc = 0.691157
Epoch 5482
Loss = 1.0894e-01, PNorm = 677.4936, GNorm = 4.3012, lr_0 = 9.9631e-04
Validation auc = 0.682218
Epoch 5483
Loss = 3.0589e-02, PNorm = 677.5470, GNorm = 0.4789, lr_0 = 9.9631e-04
Validation auc = 0.676741
Epoch 5484
Loss = 6.5520e-02, PNorm = 677.6148, GNorm = 1.1822, lr_0 = 9.9631e-04
Validation auc = 0.674214
Epoch 5485
Loss = 3.2444e-02, PNorm = 677.6807, GNorm = 1.9501, lr_0 = 9.9631e-04
Validation auc = 0.673565
Epoch 5486
Loss = 4.7869e-02, PNorm = 677.7440, GNorm = 3.9014, lr_0 = 9.9631e-04
Validation auc = 0.669034
Epoch 5487
Loss = 1.0153e-01, PNorm = 677.8080, GNorm = 6.6004, lr_0 = 9.9631e-04
Validation auc = 0.667102
Epoch 5488
Loss = 1.3464e-02, PNorm = 677.8720, GNorm = 0.9577, lr_0 = 9.9631e-04
Validation auc = 0.669632
Epoch 5489
Loss = 5.9430e-03, PNorm = 677.9202, GNorm = 0.3245, lr_0 = 9.9631e-04
Loss = 6.2210e-02, PNorm = 677.9644, GNorm = 1.3976, lr_0 = 9.9631e-04
Validation auc = 0.667899
Epoch 5490
Loss = 4.7026e-02, PNorm = 678.0105, GNorm = 1.5587, lr_0 = 9.9631e-04
Validation auc = 0.670413
Epoch 5491
Loss = 4.5879e-02, PNorm = 678.0532, GNorm = 1.0364, lr_0 = 9.9631e-04
Validation auc = 0.675707
Epoch 5492
Loss = 2.7549e-02, PNorm = 678.0930, GNorm = 0.7709, lr_0 = 9.9631e-04
Validation auc = 0.672488
Epoch 5493
Loss = 5.6563e-02, PNorm = 678.1369, GNorm = 1.8351, lr_0 = 9.9631e-04
Validation auc = 0.666433
Epoch 5494
Loss = 1.8855e-02, PNorm = 678.1837, GNorm = 0.3195, lr_0 = 9.9631e-04
Validation auc = 0.666130
Epoch 5495
Loss = 3.0153e-02, PNorm = 678.2212, GNorm = 0.5545, lr_0 = 9.9631e-04
Validation auc = 0.678100
Epoch 5496
Loss = 7.4863e-03, PNorm = 678.2597, GNorm = 0.6112, lr_0 = 9.9630e-04
Validation auc = 0.683864
Epoch 5497
Loss = 1.5541e-02, PNorm = 678.2906, GNorm = 0.2582, lr_0 = 9.9630e-04
Validation auc = 0.698826
Epoch 5498
Loss = 5.0903e-02, PNorm = 678.3463, GNorm = 0.0443, lr_0 = 9.9630e-04
Validation auc = 0.705920
Epoch 5499
Loss = 1.0300e-02, PNorm = 678.4249, GNorm = 0.5529, lr_0 = 9.9630e-04
Loss = 5.8882e-02, PNorm = 678.4870, GNorm = 2.8431, lr_0 = 9.9630e-04
Validation auc = 0.700352
Epoch 5500
Loss = 7.1796e-02, PNorm = 678.5378, GNorm = 3.4357, lr_0 = 9.9630e-04
Validation auc = 0.695365
Epoch 5501
Loss = 6.7303e-02, PNorm = 678.5907, GNorm = 0.1832, lr_0 = 9.9630e-04
Validation auc = 0.686997
Epoch 5502
Loss = 7.2931e-02, PNorm = 678.6484, GNorm = 3.2820, lr_0 = 9.9630e-04
Validation auc = 0.679659
Epoch 5503
Loss = 8.8330e-02, PNorm = 678.7209, GNorm = 11.6841, lr_0 = 9.9630e-04
Validation auc = 0.681853
Epoch 5504
Loss = 4.2359e-02, PNorm = 678.7966, GNorm = 0.3059, lr_0 = 9.9630e-04
Validation auc = 0.678695
Epoch 5505
Loss = 4.0468e-02, PNorm = 678.8509, GNorm = 3.1707, lr_0 = 9.9630e-04
Validation auc = 0.678879
Epoch 5506
Loss = 3.8380e-02, PNorm = 678.8930, GNorm = 2.5875, lr_0 = 9.9630e-04
Validation auc = 0.684139
Epoch 5507
Loss = 1.1091e-01, PNorm = 678.9282, GNorm = 0.4824, lr_0 = 9.9630e-04
Validation auc = 0.703028
Epoch 5508
Loss = 1.0856e-01, PNorm = 678.9654, GNorm = 3.3576, lr_0 = 9.9630e-04
Validation auc = 0.713329
Epoch 5509
Loss = 3.1169e-03, PNorm = 679.0033, GNorm = 0.3113, lr_0 = 9.9630e-04
Loss = 2.7859e-02, PNorm = 679.0360, GNorm = 1.5869, lr_0 = 9.9629e-04
Validation auc = 0.714445
Epoch 5510
Loss = 2.0852e-02, PNorm = 679.0612, GNorm = 0.7127, lr_0 = 9.9629e-04
Validation auc = 0.711406
Epoch 5511
Loss = 4.7041e-02, PNorm = 679.0904, GNorm = 0.5707, lr_0 = 9.9629e-04
Validation auc = 0.712502
Epoch 5512
Loss = 1.7130e-02, PNorm = 679.1166, GNorm = 0.9636, lr_0 = 9.9629e-04
Validation auc = 0.712570
Epoch 5513
Loss = 9.1499e-02, PNorm = 679.1369, GNorm = 3.1592, lr_0 = 9.9629e-04
Validation auc = 0.713118
Epoch 5514
Loss = 1.7030e-02, PNorm = 679.1661, GNorm = 0.9155, lr_0 = 9.9629e-04
Validation auc = 0.715129
Epoch 5515
Loss = 3.8835e-02, PNorm = 679.1985, GNorm = 1.4320, lr_0 = 9.9629e-04
Validation auc = 0.716790
Epoch 5516
Loss = 1.7654e-02, PNorm = 679.2328, GNorm = 0.0427, lr_0 = 9.9629e-04
Validation auc = 0.711966
Epoch 5517
Loss = 1.8774e-02, PNorm = 679.2739, GNorm = 0.7016, lr_0 = 9.9629e-04
Validation auc = 0.710157
Epoch 5518
Loss = 8.1819e-02, PNorm = 679.3359, GNorm = 0.3144, lr_0 = 9.9629e-04
Validation auc = 0.711190
Epoch 5519
Loss = 4.1193e-02, PNorm = 679.4081, GNorm = 1.9543, lr_0 = 9.9629e-04
Loss = 5.7796e-02, PNorm = 679.4772, GNorm = 0.4918, lr_0 = 9.9629e-04
Validation auc = 0.709974
Epoch 5520
Loss = 5.0441e-02, PNorm = 679.5325, GNorm = 3.4294, lr_0 = 9.9629e-04
Validation auc = 0.717812
Epoch 5521
Loss = 3.9990e-02, PNorm = 679.5795, GNorm = 1.7869, lr_0 = 9.9629e-04
Validation auc = 0.722110
Epoch 5522
Loss = 7.3250e-02, PNorm = 679.6312, GNorm = 5.2374, lr_0 = 9.9628e-04
Validation auc = 0.716131
Epoch 5523
Loss = 4.3240e-02, PNorm = 679.6894, GNorm = 0.2065, lr_0 = 9.9628e-04
Validation auc = 0.710490
Epoch 5524
Loss = 9.7155e-02, PNorm = 679.7447, GNorm = 3.4436, lr_0 = 9.9628e-04
Validation auc = 0.700977
Epoch 5525
Loss = 1.2211e-02, PNorm = 679.8122, GNorm = 0.1314, lr_0 = 9.9628e-04
Validation auc = 0.694153
Epoch 5526
Loss = 1.8228e-02, PNorm = 679.8602, GNorm = 1.6993, lr_0 = 9.9628e-04
Validation auc = 0.687435
Epoch 5527
Loss = 2.2549e-02, PNorm = 679.8945, GNorm = 1.2161, lr_0 = 9.9628e-04
Validation auc = 0.688219
Epoch 5528
Loss = 5.6008e-02, PNorm = 679.9306, GNorm = 1.0874, lr_0 = 9.9628e-04
Validation auc = 0.690864
Epoch 5529
Loss = 9.2496e-02, PNorm = 679.9733, GNorm = 3.8894, lr_0 = 9.9628e-04
Loss = 4.9606e-02, PNorm = 680.0184, GNorm = 0.0626, lr_0 = 9.9628e-04
Validation auc = 0.693218
Epoch 5530
Loss = 1.3904e-02, PNorm = 680.0526, GNorm = 0.5412, lr_0 = 9.9628e-04
Validation auc = 0.691424
Epoch 5531
Loss = 1.9615e-02, PNorm = 680.0822, GNorm = 0.1453, lr_0 = 9.9628e-04
Validation auc = 0.688175
Epoch 5532
Loss = 4.4999e-02, PNorm = 680.1173, GNorm = 0.1185, lr_0 = 9.9628e-04
Validation auc = 0.696567
Epoch 5533
Loss = 1.2186e-01, PNorm = 680.1624, GNorm = 1.0328, lr_0 = 9.9628e-04
Validation auc = 0.703964
Epoch 5534
Loss = 6.7794e-02, PNorm = 680.2247, GNorm = 3.8643, lr_0 = 9.9628e-04
Validation auc = 0.699951
Epoch 5535
Loss = 3.6386e-02, PNorm = 680.2947, GNorm = 3.9598, lr_0 = 9.9628e-04
Validation auc = 0.704230
Epoch 5536
Loss = 9.9270e-02, PNorm = 680.3703, GNorm = 6.0960, lr_0 = 9.9627e-04
Validation auc = 0.703996
Epoch 5537
Loss = 1.3184e-01, PNorm = 680.4455, GNorm = 0.6313, lr_0 = 9.9627e-04
Validation auc = 0.688876
Epoch 5538
Loss = 2.6293e-02, PNorm = 680.5018, GNorm = 0.4238, lr_0 = 9.9627e-04
Validation auc = 0.685528
Epoch 5539
Loss = 4.0591e-03, PNorm = 680.5417, GNorm = 0.1923, lr_0 = 9.9627e-04
Loss = 3.6306e-02, PNorm = 680.5710, GNorm = 0.1533, lr_0 = 9.9627e-04
Validation auc = 0.684984
Epoch 5540
Loss = 3.6928e-02, PNorm = 680.5994, GNorm = 0.4459, lr_0 = 9.9627e-04
Validation auc = 0.685671
Epoch 5541
Loss = 5.1015e-02, PNorm = 680.6285, GNorm = 1.1781, lr_0 = 9.9627e-04
Validation auc = 0.684114
Epoch 5542
Loss = 4.0663e-02, PNorm = 680.6593, GNorm = 0.2121, lr_0 = 9.9627e-04
Validation auc = 0.677684
Epoch 5543
Loss = 2.7187e-02, PNorm = 680.7045, GNorm = 0.0787, lr_0 = 9.9627e-04
Validation auc = 0.678892
Epoch 5544
Loss = 5.3525e-02, PNorm = 680.7448, GNorm = 0.2973, lr_0 = 9.9627e-04
Validation auc = 0.684229
Epoch 5545
Loss = 3.8802e-02, PNorm = 680.7806, GNorm = 2.0144, lr_0 = 9.9627e-04
Validation auc = 0.688067
Epoch 5546
Loss = 1.7923e-02, PNorm = 680.8084, GNorm = 0.6975, lr_0 = 9.9627e-04
Validation auc = 0.687513
Epoch 5547
Loss = 5.3649e-02, PNorm = 680.8303, GNorm = 13.6586, lr_0 = 9.9627e-04
Validation auc = 0.649321
Epoch 5548
Loss = 3.4874e-01, PNorm = 680.9450, GNorm = 4.3008, lr_0 = 9.9627e-04
Validation auc = 0.652305
Epoch 5549
Loss = 3.6989e-02, PNorm = 681.0718, GNorm = 1.7854, lr_0 = 9.9626e-04
Loss = 1.2513e-01, PNorm = 681.1766, GNorm = 2.4560, lr_0 = 9.9626e-04
Validation auc = 0.668255
Epoch 5550
Loss = 8.4828e-02, PNorm = 681.2548, GNorm = 7.5218, lr_0 = 9.9626e-04
Validation auc = 0.664621
Epoch 5551
Loss = 7.7889e-02, PNorm = 681.3351, GNorm = 0.5070, lr_0 = 9.9626e-04
Validation auc = 0.663648
Epoch 5552
Loss = 1.0084e-01, PNorm = 681.4107, GNorm = 5.4716, lr_0 = 9.9626e-04
Validation auc = 0.671596
Epoch 5553
Loss = 7.7185e-02, PNorm = 681.4825, GNorm = 5.2720, lr_0 = 9.9626e-04
Validation auc = 0.679718
Epoch 5554
Loss = 5.1194e-02, PNorm = 681.5478, GNorm = 3.9101, lr_0 = 9.9626e-04
Validation auc = 0.696678
Epoch 5555
Loss = 9.4908e-02, PNorm = 681.6137, GNorm = 5.3951, lr_0 = 9.9626e-04
Validation auc = 0.679328
Epoch 5556
Loss = 1.2325e-01, PNorm = 681.6779, GNorm = 1.2331, lr_0 = 9.9626e-04
Validation auc = 0.672407
Epoch 5557
Loss = 1.5486e-01, PNorm = 681.7398, GNorm = 6.3650, lr_0 = 9.9626e-04
Validation auc = 0.674912
Epoch 5558
Loss = 3.7514e-02, PNorm = 681.8051, GNorm = 3.9657, lr_0 = 9.9626e-04
Validation auc = 0.680754
Epoch 5559
Loss = 3.0298e-02, PNorm = 681.8649, GNorm = 1.7293, lr_0 = 9.9626e-04
Loss = 5.0937e-02, PNorm = 681.9404, GNorm = 2.1142, lr_0 = 9.9626e-04
Validation auc = 0.676140
Epoch 5560
Loss = 1.3635e-01, PNorm = 682.0108, GNorm = 7.7936, lr_0 = 9.9626e-04
Validation auc = 0.666329
Epoch 5561
Loss = 1.1311e-01, PNorm = 682.0834, GNorm = 2.4191, lr_0 = 9.9626e-04
Validation auc = 0.673614
Epoch 5562
Loss = 4.7077e-02, PNorm = 682.1671, GNorm = 0.3584, lr_0 = 9.9625e-04
Validation auc = 0.691513
Epoch 5563
Loss = 1.6877e-01, PNorm = 682.2304, GNorm = 2.3590, lr_0 = 9.9625e-04
Validation auc = 0.706236
Epoch 5564
Loss = 6.5397e-02, PNorm = 682.2927, GNorm = 2.9197, lr_0 = 9.9625e-04
Validation auc = 0.708380
Epoch 5565
Loss = 8.9730e-02, PNorm = 682.3531, GNorm = 7.6629, lr_0 = 9.9625e-04
Validation auc = 0.706638
Epoch 5566
Loss = 7.3057e-02, PNorm = 682.4100, GNorm = 1.9549, lr_0 = 9.9625e-04
Validation auc = 0.711272
Epoch 5567
Loss = 4.8464e-01, PNorm = 682.4753, GNorm = 3.5028, lr_0 = 9.9625e-04
Validation auc = 0.694425
Epoch 5568
Loss = 3.3136e-02, PNorm = 682.5609, GNorm = 2.3564, lr_0 = 9.9625e-04
Validation auc = 0.682082
Epoch 5569
Loss = 3.3398e-02, PNorm = 682.6304, GNorm = 2.4729, lr_0 = 9.9625e-04
Loss = 1.1581e-01, PNorm = 682.6997, GNorm = 5.0366, lr_0 = 9.9625e-04
Validation auc = 0.698091
Epoch 5570
Loss = 8.9443e-02, PNorm = 682.7687, GNorm = 0.2115, lr_0 = 9.9625e-04
Validation auc = 0.696475
Epoch 5571
Loss = 7.0023e-02, PNorm = 682.8276, GNorm = 2.7380, lr_0 = 9.9625e-04
Validation auc = 0.705059
Epoch 5572
Loss = 7.7587e-02, PNorm = 682.8920, GNorm = 2.6298, lr_0 = 9.9625e-04
Validation auc = 0.713126
Epoch 5573
Loss = 4.0385e-02, PNorm = 682.9568, GNorm = 8.9823, lr_0 = 9.9625e-04
Validation auc = 0.699260
Epoch 5574
Loss = 4.9630e-02, PNorm = 683.0162, GNorm = 3.4924, lr_0 = 9.9625e-04
Validation auc = 0.680931
Epoch 5575
Loss = 5.4641e-02, PNorm = 683.0687, GNorm = 4.0063, lr_0 = 9.9625e-04
Validation auc = 0.674755
Epoch 5576
Loss = 4.9124e-02, PNorm = 683.1189, GNorm = 4.6707, lr_0 = 9.9624e-04
Validation auc = 0.670848
Epoch 5577
Loss = 2.3634e-01, PNorm = 683.1737, GNorm = 1.2855, lr_0 = 9.9624e-04
Validation auc = 0.679401
Epoch 5578
Loss = 1.1933e-02, PNorm = 683.2278, GNorm = 0.8150, lr_0 = 9.9624e-04
Validation auc = 0.692163
Epoch 5579
Loss = 5.9134e-02, PNorm = 683.2712, GNorm = 1.9909, lr_0 = 9.9624e-04
Loss = 2.4552e-02, PNorm = 683.3055, GNorm = 2.2747, lr_0 = 9.9624e-04
Validation auc = 0.697816
Epoch 5580
Loss = 1.2961e-01, PNorm = 683.3504, GNorm = 0.7189, lr_0 = 9.9624e-04
Validation auc = 0.695617
Epoch 5581
Loss = 7.4170e-02, PNorm = 683.4038, GNorm = 3.2635, lr_0 = 9.9624e-04
Validation auc = 0.683944
Epoch 5582
Loss = 8.2548e-02, PNorm = 683.4504, GNorm = 1.0838, lr_0 = 9.9624e-04
Validation auc = 0.683771
Epoch 5583
Loss = 1.0417e-01, PNorm = 683.4973, GNorm = 2.9187, lr_0 = 9.9624e-04
Validation auc = 0.684725
Epoch 5584
Loss = 6.2578e-02, PNorm = 683.5610, GNorm = 1.2578, lr_0 = 9.9624e-04
Validation auc = 0.694524
Epoch 5585
Loss = 7.2500e-02, PNorm = 683.6217, GNorm = 2.7904, lr_0 = 9.9624e-04
Validation auc = 0.687887
Epoch 5586
Loss = 3.1347e-02, PNorm = 683.6753, GNorm = 1.1778, lr_0 = 9.9624e-04
Validation auc = 0.681705
Epoch 5587
Loss = 4.6586e-02, PNorm = 683.7235, GNorm = 3.6266, lr_0 = 9.9624e-04
Validation auc = 0.678826
Epoch 5588
Loss = 8.5148e-02, PNorm = 683.7715, GNorm = 2.0180, lr_0 = 9.9624e-04
Validation auc = 0.684638
Epoch 5589
Loss = 1.7475e-02, PNorm = 683.8170, GNorm = 1.4423, lr_0 = 9.9623e-04
Loss = 2.8012e-02, PNorm = 683.8587, GNorm = 0.4988, lr_0 = 9.9623e-04
Validation auc = 0.685373
Epoch 5590
Loss = 2.9004e-02, PNorm = 683.8965, GNorm = 0.5257, lr_0 = 9.9623e-04
Validation auc = 0.683031
Epoch 5591
Loss = 3.5080e-02, PNorm = 683.9306, GNorm = 2.6734, lr_0 = 9.9623e-04
Validation auc = 0.680731
Epoch 5592
Loss = 5.7505e-02, PNorm = 683.9733, GNorm = 0.4434, lr_0 = 9.9623e-04
Validation auc = 0.675595
Epoch 5593
Loss = 1.8293e-02, PNorm = 684.0199, GNorm = 0.1419, lr_0 = 9.9623e-04
Validation auc = 0.675874
Epoch 5594
Loss = 4.7684e-02, PNorm = 684.0578, GNorm = 0.4349, lr_0 = 9.9623e-04
Validation auc = 0.675073
Epoch 5595
Loss = 1.3988e-02, PNorm = 684.0938, GNorm = 0.1046, lr_0 = 9.9623e-04
Validation auc = 0.673363
Epoch 5596
Loss = 1.6466e-02, PNorm = 684.1306, GNorm = 0.1213, lr_0 = 9.9623e-04
Validation auc = 0.671040
Epoch 5597
Loss = 1.2770e-02, PNorm = 684.1679, GNorm = 0.3902, lr_0 = 9.9623e-04
Validation auc = 0.670571
Epoch 5598
Loss = 3.6181e-03, PNorm = 684.2072, GNorm = 0.1602, lr_0 = 9.9623e-04
Validation auc = 0.679474
Epoch 5599
Loss = 4.0627e-02, PNorm = 684.2464, GNorm = 2.2771, lr_0 = 9.9623e-04
Loss = 7.1107e-02, PNorm = 684.2787, GNorm = 5.8340, lr_0 = 9.9623e-04
Validation auc = 0.684718
Epoch 5600
Loss = 4.0004e-02, PNorm = 684.3162, GNorm = 1.4673, lr_0 = 9.9623e-04
Validation auc = 0.684021
Epoch 5601
Loss = 3.9907e-02, PNorm = 684.3509, GNorm = 2.7350, lr_0 = 9.9623e-04
Validation auc = 0.688316
Epoch 5602
Loss = 1.9719e-02, PNorm = 684.3799, GNorm = 0.8012, lr_0 = 9.9622e-04
Validation auc = 0.688630
Epoch 5603
Loss = 2.9007e-02, PNorm = 684.4024, GNorm = 3.1757, lr_0 = 9.9622e-04
Validation auc = 0.694681
Epoch 5604
Loss = 1.6040e-02, PNorm = 684.4248, GNorm = 0.2431, lr_0 = 9.9622e-04
Validation auc = 0.697211
Epoch 5605
Loss = 7.1837e-02, PNorm = 684.4570, GNorm = 3.4802, lr_0 = 9.9622e-04
Validation auc = 0.694323
Epoch 5606
Loss = 6.2042e-02, PNorm = 684.4953, GNorm = 3.6358, lr_0 = 9.9622e-04
Validation auc = 0.693301
Epoch 5607
Loss = 1.5710e-02, PNorm = 684.5353, GNorm = 1.3383, lr_0 = 9.9622e-04
Validation auc = 0.693306
Epoch 5608
Loss = 6.3269e-02, PNorm = 684.5692, GNorm = 4.9918, lr_0 = 9.9622e-04
Validation auc = 0.696536
Epoch 5609
Loss = 1.0221e-02, PNorm = 684.6099, GNorm = 0.6134, lr_0 = 9.9622e-04
Loss = 2.7876e-02, PNorm = 684.6524, GNorm = 0.1116, lr_0 = 9.9622e-04
Validation auc = 0.694895
Epoch 5610
Loss = 3.3605e-02, PNorm = 684.6833, GNorm = 1.9840, lr_0 = 9.9622e-04
Validation auc = 0.695919
Epoch 5611
Loss = 3.7966e-02, PNorm = 684.7151, GNorm = 0.4958, lr_0 = 9.9622e-04
Validation auc = 0.689124
Epoch 5612
Loss = 4.3754e-02, PNorm = 684.7571, GNorm = 0.9816, lr_0 = 9.9622e-04
Validation auc = 0.681148
Epoch 5613
Loss = 2.5531e-02, PNorm = 684.7943, GNorm = 0.4945, lr_0 = 9.9622e-04
Validation auc = 0.682366
Epoch 5614
Loss = 2.8940e-02, PNorm = 684.8223, GNorm = 1.5867, lr_0 = 9.9622e-04
Validation auc = 0.680749
Epoch 5615
Loss = 3.4482e-02, PNorm = 684.8493, GNorm = 4.6384, lr_0 = 9.9621e-04
Validation auc = 0.685119
Epoch 5616
Loss = 3.6127e-02, PNorm = 684.8764, GNorm = 2.0565, lr_0 = 9.9621e-04
Validation auc = 0.685354
Epoch 5617
Loss = 8.2285e-02, PNorm = 684.9021, GNorm = 0.3356, lr_0 = 9.9621e-04
Validation auc = 0.690469
Epoch 5618
Loss = 2.1961e-02, PNorm = 684.9358, GNorm = 1.9483, lr_0 = 9.9621e-04
Validation auc = 0.686851
Epoch 5619
Loss = 1.0437e-01, PNorm = 684.9808, GNorm = 3.3623, lr_0 = 9.9621e-04
Loss = 2.1158e-02, PNorm = 685.0348, GNorm = 0.3354, lr_0 = 9.9621e-04
Validation auc = 0.684321
Epoch 5620
Loss = 7.3005e-02, PNorm = 685.0738, GNorm = 3.9171, lr_0 = 9.9621e-04
Validation auc = 0.682706
Epoch 5621
Loss = 5.6075e-02, PNorm = 685.1201, GNorm = 0.6538, lr_0 = 9.9621e-04
Validation auc = 0.681864
Epoch 5622
Loss = 3.8027e-02, PNorm = 685.1578, GNorm = 2.3527, lr_0 = 9.9621e-04
Validation auc = 0.684690
Epoch 5623
Loss = 8.3642e-02, PNorm = 685.1944, GNorm = 1.6840, lr_0 = 9.9621e-04
Validation auc = 0.688684
Epoch 5624
Loss = 3.7919e-02, PNorm = 685.2363, GNorm = 1.6042, lr_0 = 9.9621e-04
Validation auc = 0.684673
Epoch 5625
Loss = 2.3429e-02, PNorm = 685.2738, GNorm = 0.7060, lr_0 = 9.9621e-04
Validation auc = 0.676856
Epoch 5626
Loss = 1.1888e-02, PNorm = 685.2998, GNorm = 1.4844, lr_0 = 9.9621e-04
Validation auc = 0.678087
Epoch 5627
Loss = 8.7171e-02, PNorm = 685.3326, GNorm = 1.5677, lr_0 = 9.9621e-04
Validation auc = 0.692976
Epoch 5628
Loss = 5.7424e-01, PNorm = 685.4030, GNorm = 3.5582, lr_0 = 9.9621e-04
Validation auc = 0.695690
Epoch 5629
Loss = 5.5818e-02, PNorm = 685.6000, GNorm = 1.5437, lr_0 = 9.9620e-04
Loss = 9.7760e-02, PNorm = 685.7461, GNorm = 3.2322, lr_0 = 9.9620e-04
Validation auc = 0.683388
Epoch 5630
Loss = 1.1232e-01, PNorm = 685.8613, GNorm = 2.1461, lr_0 = 9.9620e-04
Validation auc = 0.680637
Epoch 5631
Loss = 6.7058e-02, PNorm = 685.9682, GNorm = 3.9540, lr_0 = 9.9620e-04
Validation auc = 0.680104
Epoch 5632
Loss = 8.1053e-02, PNorm = 686.0539, GNorm = 5.8425, lr_0 = 9.9620e-04
Validation auc = 0.684842
Epoch 5633
Loss = 1.3041e-01, PNorm = 686.1273, GNorm = 0.4671, lr_0 = 9.9620e-04
Validation auc = 0.696466
Epoch 5634
Loss = 4.0333e-02, PNorm = 686.1903, GNorm = 1.1289, lr_0 = 9.9620e-04
Validation auc = 0.693811
Epoch 5635
Loss = 6.9257e-02, PNorm = 686.2361, GNorm = 2.0879, lr_0 = 9.9620e-04
Validation auc = 0.689295
Epoch 5636
Loss = 1.1374e-02, PNorm = 686.2882, GNorm = 0.3270, lr_0 = 9.9620e-04
Validation auc = 0.679919
Epoch 5637
Loss = 7.3821e-02, PNorm = 686.3375, GNorm = 1.9171, lr_0 = 9.9620e-04
Validation auc = 0.676487
Epoch 5638
Loss = 4.2257e-02, PNorm = 686.3822, GNorm = 1.2060, lr_0 = 9.9620e-04
Validation auc = 0.677602
Epoch 5639
Loss = 8.8849e-02, PNorm = 686.4222, GNorm = 3.2824, lr_0 = 9.9620e-04
Loss = 9.4597e-02, PNorm = 686.4844, GNorm = 6.9255, lr_0 = 9.9620e-04
Validation auc = 0.680427
Epoch 5640
Loss = 3.5013e-02, PNorm = 686.5442, GNorm = 0.0820, lr_0 = 9.9620e-04
Validation auc = 0.686303
Epoch 5641
Loss = 2.7284e-02, PNorm = 686.5886, GNorm = 0.5489, lr_0 = 9.9619e-04
Validation auc = 0.693434
Epoch 5642
Loss = 6.6708e-02, PNorm = 686.6257, GNorm = 1.6818, lr_0 = 9.9619e-04
Validation auc = 0.695682
Epoch 5643
Loss = 9.2762e-02, PNorm = 686.6790, GNorm = 3.8256, lr_0 = 9.9619e-04
Validation auc = 0.692288
Epoch 5644
Loss = 3.2174e-02, PNorm = 686.7536, GNorm = 0.3776, lr_0 = 9.9619e-04
Validation auc = 0.698833
Epoch 5645
Loss = 2.5349e-02, PNorm = 686.8167, GNorm = 2.5523, lr_0 = 9.9619e-04
Validation auc = 0.703231
Epoch 5646
Loss = 8.7156e-02, PNorm = 686.8685, GNorm = 3.8165, lr_0 = 9.9619e-04
Validation auc = 0.706366
Epoch 5647
Loss = 3.1452e-02, PNorm = 686.9267, GNorm = 0.4929, lr_0 = 9.9619e-04
Validation auc = 0.707415
Epoch 5648
Loss = 8.4920e-02, PNorm = 686.9714, GNorm = 11.0487, lr_0 = 9.9619e-04
Validation auc = 0.698315
Epoch 5649
Loss = 2.3954e-01, PNorm = 687.0133, GNorm = 6.3125, lr_0 = 9.9619e-04
Loss = 6.4960e-02, PNorm = 687.0605, GNorm = 1.4360, lr_0 = 9.9619e-04
Validation auc = 0.687450
Epoch 5650
Loss = 7.3766e-02, PNorm = 687.1100, GNorm = 0.7690, lr_0 = 9.9619e-04
Validation auc = 0.678815
Epoch 5651
Loss = 3.6640e-02, PNorm = 687.1687, GNorm = 0.8857, lr_0 = 9.9619e-04
Validation auc = 0.677103
Epoch 5652
Loss = 5.3065e-02, PNorm = 687.2142, GNorm = 1.5436, lr_0 = 9.9619e-04
Validation auc = 0.674962
Epoch 5653
Loss = 3.6190e-02, PNorm = 687.2639, GNorm = 2.7707, lr_0 = 9.9619e-04
Validation auc = 0.674583
Epoch 5654
Loss = 5.0617e-02, PNorm = 687.3029, GNorm = 0.1097, lr_0 = 9.9619e-04
Validation auc = 0.673431
Epoch 5655
Loss = 4.0115e-02, PNorm = 687.3349, GNorm = 7.3127, lr_0 = 9.9618e-04
Validation auc = 0.675483
Epoch 5656
Loss = 5.5508e-02, PNorm = 687.3776, GNorm = 9.1531, lr_0 = 9.9618e-04
Validation auc = 0.673972
Epoch 5657
Loss = 1.1672e-02, PNorm = 687.4266, GNorm = 0.6261, lr_0 = 9.9618e-04
Validation auc = 0.671641
Epoch 5658
Loss = 2.0182e-02, PNorm = 687.4714, GNorm = 0.8829, lr_0 = 9.9618e-04
Validation auc = 0.677062
Epoch 5659
Loss = 9.4464e-02, PNorm = 687.5095, GNorm = 2.8758, lr_0 = 9.9618e-04
Loss = 1.2959e-01, PNorm = 687.5720, GNorm = 0.1496, lr_0 = 9.9618e-04
Validation auc = 0.690741
Epoch 5660
Loss = 4.7369e-02, PNorm = 687.6293, GNorm = 0.8461, lr_0 = 9.9618e-04
Validation auc = 0.692520
Epoch 5661
Loss = 7.6911e-02, PNorm = 687.6836, GNorm = 0.6407, lr_0 = 9.9618e-04
Validation auc = 0.685889
Epoch 5662
Loss = 2.3259e-02, PNorm = 687.7322, GNorm = 0.1827, lr_0 = 9.9618e-04
Validation auc = 0.681993
Epoch 5663
Loss = 3.4376e-02, PNorm = 687.7659, GNorm = 0.7137, lr_0 = 9.9618e-04
Validation auc = 0.678813
Epoch 5664
Loss = 4.7270e-02, PNorm = 687.8020, GNorm = 2.2656, lr_0 = 9.9618e-04
Validation auc = 0.678706
Epoch 5665
Loss = 7.8884e-02, PNorm = 687.8377, GNorm = 0.1376, lr_0 = 9.9618e-04
Validation auc = 0.676687
Epoch 5666
Loss = 5.5189e-02, PNorm = 687.8690, GNorm = 0.1177, lr_0 = 9.9618e-04
Validation auc = 0.683283
Epoch 5667
Loss = 5.6440e-02, PNorm = 687.9174, GNorm = 0.8896, lr_0 = 9.9618e-04
Validation auc = 0.693586
Epoch 5668
Loss = 5.5303e-02, PNorm = 687.9702, GNorm = 1.7080, lr_0 = 9.9618e-04
Validation auc = 0.690985
Epoch 5669
Loss = 8.8209e-02, PNorm = 688.0212, GNorm = 3.2671, lr_0 = 9.9617e-04
Loss = 1.4631e-01, PNorm = 688.0827, GNorm = 5.0451, lr_0 = 9.9617e-04
Validation auc = 0.692312
Epoch 5670
Loss = 9.6954e-02, PNorm = 688.1640, GNorm = 1.7577, lr_0 = 9.9617e-04
Validation auc = 0.690583
Epoch 5671
Loss = 4.9405e-02, PNorm = 688.2342, GNorm = 1.9287, lr_0 = 9.9617e-04
Validation auc = 0.694435
Epoch 5672
Loss = 5.1928e-02, PNorm = 688.2924, GNorm = 0.3221, lr_0 = 9.9617e-04
Validation auc = 0.691209
Epoch 5673
Loss = 1.7789e-01, PNorm = 688.3482, GNorm = 2.3285, lr_0 = 9.9617e-04
Validation auc = 0.691192
Epoch 5674
Loss = 1.5178e-01, PNorm = 688.4048, GNorm = 20.0155, lr_0 = 9.9617e-04
Validation auc = 0.684933
Epoch 5675
Loss = 1.1009e-01, PNorm = 688.4701, GNorm = 4.5275, lr_0 = 9.9617e-04
Validation auc = 0.680026
Epoch 5676
Loss = 3.2035e-02, PNorm = 688.5371, GNorm = 2.3892, lr_0 = 9.9617e-04
Validation auc = 0.681191
Epoch 5677
Loss = 2.4823e-02, PNorm = 688.5886, GNorm = 1.3472, lr_0 = 9.9617e-04
Validation auc = 0.682458
Epoch 5678
Loss = 2.0373e-02, PNorm = 688.6268, GNorm = 0.3120, lr_0 = 9.9617e-04
Validation auc = 0.684905
Epoch 5679
Loss = 1.6970e-02, PNorm = 688.6543, GNorm = 1.1587, lr_0 = 9.9617e-04
Loss = 4.4703e-02, PNorm = 688.6915, GNorm = 0.7454, lr_0 = 9.9617e-04
Validation auc = 0.690274
Epoch 5680
Loss = 6.7887e-02, PNorm = 688.7429, GNorm = 0.8372, lr_0 = 9.9617e-04
Validation auc = 0.688904
Epoch 5681
Loss = 3.9291e-02, PNorm = 688.7930, GNorm = 1.5118, lr_0 = 9.9616e-04
Validation auc = 0.689937
Epoch 5682
Loss = 6.6509e-02, PNorm = 688.8363, GNorm = 0.9758, lr_0 = 9.9616e-04
Validation auc = 0.689504
Epoch 5683
Loss = 2.1107e-02, PNorm = 688.8911, GNorm = 0.7453, lr_0 = 9.9616e-04
Validation auc = 0.692840
Epoch 5684
Loss = 4.2672e-02, PNorm = 688.9396, GNorm = 2.4387, lr_0 = 9.9616e-04
Validation auc = 0.699053
Epoch 5685
Loss = 7.4305e-02, PNorm = 688.9816, GNorm = 0.5091, lr_0 = 9.9616e-04
Validation auc = 0.696194
Epoch 5686
Loss = 5.4964e-02, PNorm = 689.0319, GNorm = 2.3920, lr_0 = 9.9616e-04
Validation auc = 0.688038
Epoch 5687
Loss = 4.1895e-02, PNorm = 689.1021, GNorm = 1.8034, lr_0 = 9.9616e-04
Validation auc = 0.679302
Epoch 5688
Loss = 4.2970e-02, PNorm = 689.1767, GNorm = 3.2129, lr_0 = 9.9616e-04
Validation auc = 0.677309
Epoch 5689
Loss = 5.7361e-02, PNorm = 689.2345, GNorm = 1.8500, lr_0 = 9.9616e-04
Loss = 5.1484e-02, PNorm = 689.2832, GNorm = 0.5053, lr_0 = 9.9616e-04
Validation auc = 0.676297
Epoch 5690
Loss = 9.3253e-02, PNorm = 689.3360, GNorm = 7.1457, lr_0 = 9.9616e-04
Validation auc = 0.676525
Epoch 5691
Loss = 3.2817e-02, PNorm = 689.3868, GNorm = 2.3039, lr_0 = 9.9616e-04
Validation auc = 0.678107
Epoch 5692
Loss = 3.4378e-02, PNorm = 689.4372, GNorm = 2.8803, lr_0 = 9.9616e-04
Validation auc = 0.679212
Epoch 5693
Loss = 1.4419e-01, PNorm = 689.4918, GNorm = 6.5297, lr_0 = 9.9616e-04
Validation auc = 0.680393
Epoch 5694
Loss = 1.1273e-01, PNorm = 689.5514, GNorm = 0.3334, lr_0 = 9.9616e-04
Validation auc = 0.685686
Epoch 5695
Loss = 2.5723e-02, PNorm = 689.6096, GNorm = 1.0517, lr_0 = 9.9615e-04
Validation auc = 0.687914
Epoch 5696
Loss = 5.1523e-02, PNorm = 689.6655, GNorm = 0.5148, lr_0 = 9.9615e-04
Validation auc = 0.674842
Epoch 5697
Loss = 7.8937e-02, PNorm = 689.7242, GNorm = 0.7724, lr_0 = 9.9615e-04
Validation auc = 0.658571
Epoch 5698
Loss = 4.4417e-02, PNorm = 689.7972, GNorm = 0.7457, lr_0 = 9.9615e-04
Validation auc = 0.646246
Epoch 5699
Loss = 1.9993e-01, PNorm = 689.8673, GNorm = 4.5525, lr_0 = 9.9615e-04
Loss = 8.7736e-02, PNorm = 689.9345, GNorm = 3.4094, lr_0 = 9.9615e-04
Validation auc = 0.641164
Epoch 5700
Loss = 3.8334e-02, PNorm = 689.9947, GNorm = 2.1334, lr_0 = 9.9615e-04
Validation auc = 0.639216
Epoch 5701
Loss = 1.4603e-01, PNorm = 690.0453, GNorm = 3.8065, lr_0 = 9.9615e-04
Validation auc = 0.639477
Epoch 5702
Loss = 1.0100e-01, PNorm = 690.1119, GNorm = 0.8371, lr_0 = 9.9615e-04
Validation auc = 0.654997
Epoch 5703
Loss = 7.4521e-02, PNorm = 690.1761, GNorm = 3.5538, lr_0 = 9.9615e-04
Validation auc = 0.666595
Epoch 5704
Loss = 8.3078e-02, PNorm = 690.2300, GNorm = 4.0061, lr_0 = 9.9615e-04
Validation auc = 0.669094
Epoch 5705
Loss = 1.0856e-01, PNorm = 690.2818, GNorm = 1.2526, lr_0 = 9.9615e-04
Validation auc = 0.669215
Epoch 5706
Loss = 3.4689e-02, PNorm = 690.3523, GNorm = 8.2111, lr_0 = 9.9615e-04
Validation auc = 0.671483
Epoch 5707
Loss = 3.0972e-01, PNorm = 690.4329, GNorm = 3.6463, lr_0 = 9.9615e-04
Validation auc = 0.663628
Epoch 5708
Loss = 3.6286e-02, PNorm = 690.5265, GNorm = 1.9618, lr_0 = 9.9614e-04
Validation auc = 0.658795
Epoch 5709
Loss = 3.6196e-02, PNorm = 690.5951, GNorm = 1.6157, lr_0 = 9.9614e-04
Loss = 5.4526e-02, PNorm = 690.6423, GNorm = 2.7029, lr_0 = 9.9614e-04
Validation auc = 0.653060
Epoch 5710
Loss = 1.5098e-01, PNorm = 690.7216, GNorm = 3.3735, lr_0 = 9.9614e-04
Validation auc = 0.656737
Epoch 5711
Loss = 8.1981e-02, PNorm = 690.7934, GNorm = 1.1087, lr_0 = 9.9614e-04
Validation auc = 0.660261
Epoch 5712
Loss = 6.2885e-02, PNorm = 690.8645, GNorm = 1.4891, lr_0 = 9.9614e-04
Validation auc = 0.659134
Epoch 5713
Loss = 2.5689e-02, PNorm = 690.9297, GNorm = 1.2916, lr_0 = 9.9614e-04
Validation auc = 0.665077
Epoch 5714
Loss = 7.3487e-02, PNorm = 690.9839, GNorm = 1.2307, lr_0 = 9.9614e-04
Validation auc = 0.673528
Epoch 5715
Loss = 8.3572e-02, PNorm = 691.0387, GNorm = 0.9043, lr_0 = 9.9614e-04
Validation auc = 0.673959
Epoch 5716
Loss = 1.3043e-01, PNorm = 691.0831, GNorm = 7.6258, lr_0 = 9.9614e-04
Validation auc = 0.669619
Epoch 5717
Loss = 3.6329e-02, PNorm = 691.1336, GNorm = 2.0658, lr_0 = 9.9614e-04
Validation auc = 0.673819
Epoch 5718
Loss = 7.6517e-02, PNorm = 691.1779, GNorm = 3.2834, lr_0 = 9.9614e-04
Validation auc = 0.677221
Epoch 5719
Loss = 4.8983e-02, PNorm = 691.2144, GNorm = 4.3331, lr_0 = 9.9614e-04
Loss = 3.1004e-02, PNorm = 691.2533, GNorm = 1.4902, lr_0 = 9.9614e-04
Validation auc = 0.675450
Epoch 5720
Loss = 4.0631e-02, PNorm = 691.2975, GNorm = 0.1795, lr_0 = 9.9614e-04
Validation auc = 0.676762
Epoch 5721
Loss = 6.8467e-02, PNorm = 691.3485, GNorm = 4.3534, lr_0 = 9.9613e-04
Validation auc = 0.678136
Epoch 5722
Loss = 6.1512e-02, PNorm = 691.3982, GNorm = 0.7423, lr_0 = 9.9613e-04
Validation auc = 0.671515
Epoch 5723
Loss = 9.3582e-02, PNorm = 691.4549, GNorm = 6.4253, lr_0 = 9.9613e-04
Validation auc = 0.670720
Epoch 5724
Loss = 5.2346e-02, PNorm = 691.5158, GNorm = 1.8164, lr_0 = 9.9613e-04
Validation auc = 0.675055
Epoch 5725
Loss = 4.9980e-02, PNorm = 691.5700, GNorm = 0.5244, lr_0 = 9.9613e-04
Validation auc = 0.673903
Epoch 5726
Loss = 7.6418e-02, PNorm = 691.6189, GNorm = 0.6475, lr_0 = 9.9613e-04
Validation auc = 0.681982
Epoch 5727
Loss = 4.5014e-02, PNorm = 691.6741, GNorm = 3.2199, lr_0 = 9.9613e-04
Validation auc = 0.681123
Epoch 5728
Loss = 5.8102e-02, PNorm = 691.7363, GNorm = 5.0200, lr_0 = 9.9613e-04
Validation auc = 0.687469
Epoch 5729
Loss = 2.1990e-02, PNorm = 691.7908, GNorm = 1.3920, lr_0 = 9.9613e-04
Loss = 5.0056e-02, PNorm = 691.8347, GNorm = 2.6061, lr_0 = 9.9613e-04
Validation auc = 0.690266
Epoch 5730
Loss = 7.5788e-02, PNorm = 691.8738, GNorm = 1.9507, lr_0 = 9.9613e-04
Validation auc = 0.691744
Epoch 5731
Loss = 3.5395e-02, PNorm = 691.9127, GNorm = 3.2604, lr_0 = 9.9613e-04
Validation auc = 0.691124
Epoch 5732
Loss = 3.7598e-02, PNorm = 691.9502, GNorm = 0.7829, lr_0 = 9.9613e-04
Validation auc = 0.690517
Epoch 5733
Loss = 3.6060e-02, PNorm = 691.9859, GNorm = 4.2063, lr_0 = 9.9613e-04
Validation auc = 0.691384
Epoch 5734
Loss = 6.3579e-02, PNorm = 692.0158, GNorm = 0.1356, lr_0 = 9.9612e-04
Validation auc = 0.691860
Epoch 5735
Loss = 4.1531e-02, PNorm = 692.0424, GNorm = 0.7616, lr_0 = 9.9612e-04
Validation auc = 0.690200
Epoch 5736
Loss = 4.4611e-02, PNorm = 692.0709, GNorm = 5.4375, lr_0 = 9.9612e-04
Validation auc = 0.686770
Epoch 5737
Loss = 3.2463e-02, PNorm = 692.0988, GNorm = 0.2256, lr_0 = 9.9612e-04
Validation auc = 0.689592
Epoch 5738
Loss = 1.4271e-02, PNorm = 692.1290, GNorm = 1.0125, lr_0 = 9.9612e-04
Validation auc = 0.694547
Epoch 5739
Loss = 5.7832e-03, PNorm = 692.1661, GNorm = 0.4357, lr_0 = 9.9612e-04
Loss = 5.1656e-02, PNorm = 692.2408, GNorm = 1.7213, lr_0 = 9.9612e-04
Validation auc = 0.707061
Epoch 5740
Loss = 3.3580e-02, PNorm = 692.2978, GNorm = 5.4094, lr_0 = 9.9612e-04
Validation auc = 0.710238
Epoch 5741
Loss = 4.7418e-02, PNorm = 692.3398, GNorm = 2.2961, lr_0 = 9.9612e-04
Validation auc = 0.710527
Epoch 5742
Loss = 8.6123e-02, PNorm = 692.3813, GNorm = 0.4529, lr_0 = 9.9612e-04
Validation auc = 0.710469
Epoch 5743
Loss = 4.3008e-02, PNorm = 692.4266, GNorm = 1.9818, lr_0 = 9.9612e-04
Validation auc = 0.709003
Epoch 5744
Loss = 3.9822e-02, PNorm = 692.4625, GNorm = 1.5368, lr_0 = 9.9612e-04
Validation auc = 0.705753
Epoch 5745
Loss = 6.0676e-02, PNorm = 692.4953, GNorm = 3.4100, lr_0 = 9.9612e-04
Validation auc = 0.705277
Epoch 5746
Loss = 6.5477e-02, PNorm = 692.5288, GNorm = 3.3610, lr_0 = 9.9612e-04
Validation auc = 0.707530
Epoch 5747
Loss = 2.7505e-02, PNorm = 692.5782, GNorm = 2.7437, lr_0 = 9.9612e-04
Validation auc = 0.705810
Epoch 5748
Loss = 1.2464e-01, PNorm = 692.6352, GNorm = 0.2714, lr_0 = 9.9611e-04
Validation auc = 0.715296
Epoch 5749
Loss = 4.6256e-02, PNorm = 692.6905, GNorm = 1.4724, lr_0 = 9.9611e-04
Loss = 9.9905e-02, PNorm = 692.7547, GNorm = 6.4467, lr_0 = 9.9611e-04
Validation auc = 0.715962
Epoch 5750
Loss = 4.3708e-02, PNorm = 692.8295, GNorm = 1.2571, lr_0 = 9.9611e-04
Validation auc = 0.707514
Epoch 5751
Loss = 4.6639e-02, PNorm = 692.8909, GNorm = 0.3436, lr_0 = 9.9611e-04
Validation auc = 0.698700
Epoch 5752
Loss = 2.1853e-02, PNorm = 692.9398, GNorm = 0.8122, lr_0 = 9.9611e-04
Validation auc = 0.706773
Epoch 5753
Loss = 3.2971e-02, PNorm = 692.9857, GNorm = 1.5360, lr_0 = 9.9611e-04
Validation auc = 0.715464
Epoch 5754
Loss = 4.7156e-02, PNorm = 693.0296, GNorm = 1.1614, lr_0 = 9.9611e-04
Validation auc = 0.716026
Epoch 5755
Loss = 3.3172e-02, PNorm = 693.0715, GNorm = 0.4915, lr_0 = 9.9611e-04
Validation auc = 0.715014
Epoch 5756
Loss = 3.5334e-02, PNorm = 693.1065, GNorm = 0.9628, lr_0 = 9.9611e-04
Validation auc = 0.712001
Epoch 5757
Loss = 5.2014e-02, PNorm = 693.1427, GNorm = 1.8104, lr_0 = 9.9611e-04
Validation auc = 0.703952
Epoch 5758
Loss = 2.7501e-02, PNorm = 693.1922, GNorm = 0.5272, lr_0 = 9.9611e-04
Validation auc = 0.696451
Epoch 5759
Loss = 1.3676e-03, PNorm = 693.2263, GNorm = 0.0906, lr_0 = 9.9611e-04
Loss = 1.7607e-02, PNorm = 693.2560, GNorm = 0.1494, lr_0 = 9.9611e-04
Validation auc = 0.691945
Epoch 5760
Loss = 1.6510e-02, PNorm = 693.2755, GNorm = 1.2831, lr_0 = 9.9611e-04
Validation auc = 0.693606
Epoch 5761
Loss = 5.4066e-02, PNorm = 693.2921, GNorm = 3.7273, lr_0 = 9.9610e-04
Validation auc = 0.697219
Epoch 5762
Loss = 3.9868e-02, PNorm = 693.3150, GNorm = 0.1825, lr_0 = 9.9610e-04
Validation auc = 0.697711
Epoch 5763
Loss = 4.5564e-02, PNorm = 693.3391, GNorm = 5.9526, lr_0 = 9.9610e-04
Validation auc = 0.700603
Epoch 5764
Loss = 3.3758e-02, PNorm = 693.3666, GNorm = 4.4287, lr_0 = 9.9610e-04
Validation auc = 0.710561
Epoch 5765
Loss = 1.9243e-02, PNorm = 693.4004, GNorm = 1.2557, lr_0 = 9.9610e-04
Validation auc = 0.721533
Epoch 5766
Loss = 4.3202e-03, PNorm = 693.4319, GNorm = 0.2043, lr_0 = 9.9610e-04
Validation auc = 0.723467
Epoch 5767
Loss = 3.7411e-02, PNorm = 693.4688, GNorm = 0.4725, lr_0 = 9.9610e-04
Validation auc = 0.727132
Epoch 5768
Loss = 4.9905e-03, PNorm = 693.5040, GNorm = 1.6155, lr_0 = 9.9610e-04
Validation auc = 0.730797
Epoch 5769
Loss = 9.7712e-03, PNorm = 693.5333, GNorm = 0.4858, lr_0 = 9.9610e-04
Loss = 5.9662e-02, PNorm = 693.5651, GNorm = 2.2141, lr_0 = 9.9610e-04
Validation auc = 0.724225
Epoch 5770
Loss = 2.9304e-02, PNorm = 693.6096, GNorm = 2.6505, lr_0 = 9.9610e-04
Validation auc = 0.714777
Epoch 5771
Loss = 7.7857e-02, PNorm = 693.6543, GNorm = 0.4956, lr_0 = 9.9610e-04
Validation auc = 0.700041
Epoch 5772
Loss = 1.8576e-02, PNorm = 693.6998, GNorm = 0.2063, lr_0 = 9.9610e-04
Validation auc = 0.691755
Epoch 5773
Loss = 2.7919e-02, PNorm = 693.7338, GNorm = 2.3988, lr_0 = 9.9610e-04
Validation auc = 0.695965
Epoch 5774
Loss = 5.6854e-02, PNorm = 693.7641, GNorm = 1.6843, lr_0 = 9.9609e-04
Validation auc = 0.700275
Epoch 5775
Loss = 2.6698e-02, PNorm = 693.7893, GNorm = 0.9843, lr_0 = 9.9609e-04
Validation auc = 0.701009
Epoch 5776
Loss = 5.7639e-03, PNorm = 693.8096, GNorm = 0.4397, lr_0 = 9.9609e-04
Validation auc = 0.703531
Epoch 5777
Loss = 4.3842e-02, PNorm = 693.8339, GNorm = 0.2285, lr_0 = 9.9609e-04
Validation auc = 0.707106
Epoch 5778
Loss = 2.9499e-03, PNorm = 693.8576, GNorm = 0.3469, lr_0 = 9.9609e-04
Validation auc = 0.710721
Epoch 5779
Loss = 4.5947e-03, PNorm = 693.8824, GNorm = 0.3392, lr_0 = 9.9609e-04
Loss = 4.5947e-02, PNorm = 693.9115, GNorm = 2.1386, lr_0 = 9.9609e-04
Validation auc = 0.715199
Epoch 5780
Loss = 5.3910e-02, PNorm = 693.9434, GNorm = 0.4212, lr_0 = 9.9609e-04
Validation auc = 0.715993
Epoch 5781
Loss = 5.3303e-02, PNorm = 693.9818, GNorm = 1.1574, lr_0 = 9.9609e-04
Validation auc = 0.714759
Epoch 5782
Loss = 3.3793e-02, PNorm = 694.0161, GNorm = 2.8908, lr_0 = 9.9609e-04
Validation auc = 0.714634
Epoch 5783
Loss = 5.4253e-02, PNorm = 694.0482, GNorm = 3.8534, lr_0 = 9.9609e-04
Validation auc = 0.717801
Epoch 5784
Loss = 3.1899e-02, PNorm = 694.0850, GNorm = 0.4544, lr_0 = 9.9609e-04
Validation auc = 0.715359
Epoch 5785
Loss = 4.1393e-02, PNorm = 694.1211, GNorm = 0.3115, lr_0 = 9.9609e-04
Validation auc = 0.713363
Epoch 5786
Loss = 6.3110e-02, PNorm = 694.1526, GNorm = 0.5179, lr_0 = 9.9609e-04
Validation auc = 0.709773
Epoch 5787
Loss = 7.5657e-02, PNorm = 694.1834, GNorm = 0.3469, lr_0 = 9.9609e-04
Validation auc = 0.706064
Epoch 5788
Loss = 8.7215e-03, PNorm = 694.2059, GNorm = 0.6789, lr_0 = 9.9608e-04
Validation auc = 0.702142
Epoch 5789
Loss = 4.5330e-02, PNorm = 694.2278, GNorm = 0.9604, lr_0 = 9.9608e-04
Loss = 1.6051e-02, PNorm = 694.2479, GNorm = 0.2372, lr_0 = 9.9608e-04
Validation auc = 0.699138
Epoch 5790
Loss = 4.6715e-02, PNorm = 694.2662, GNorm = 0.7779, lr_0 = 9.9608e-04
Validation auc = 0.693067
Epoch 5791
Loss = 3.4565e-02, PNorm = 694.2873, GNorm = 0.2040, lr_0 = 9.9608e-04
Validation auc = 0.683491
Epoch 5792
Loss = 2.1681e-02, PNorm = 694.3120, GNorm = 0.1133, lr_0 = 9.9608e-04
Validation auc = 0.680672
Epoch 5793
Loss = 2.3521e-02, PNorm = 694.3401, GNorm = 2.3492, lr_0 = 9.9608e-04
Validation auc = 0.676685
Epoch 5794
Loss = 4.2723e-02, PNorm = 694.3666, GNorm = 0.7798, lr_0 = 9.9608e-04
Validation auc = 0.674124
Epoch 5795
Loss = 7.8402e-03, PNorm = 694.3890, GNorm = 2.7996, lr_0 = 9.9608e-04
Validation auc = 0.676018
Epoch 5796
Loss = 5.1812e-02, PNorm = 694.4069, GNorm = 4.9974, lr_0 = 9.9608e-04
Validation auc = 0.679847
Epoch 5797
Loss = 1.1236e-02, PNorm = 694.4417, GNorm = 1.3636, lr_0 = 9.9608e-04
Validation auc = 0.682773
Epoch 5798
Loss = 5.6465e-02, PNorm = 694.4879, GNorm = 0.1389, lr_0 = 9.9608e-04
Validation auc = 0.684557
Epoch 5799
Loss = 9.9212e-02, PNorm = 694.5240, GNorm = 2.6690, lr_0 = 9.9608e-04
Loss = 2.9530e-02, PNorm = 694.5529, GNorm = 0.6426, lr_0 = 9.9608e-04
Validation auc = 0.685831
Epoch 5800
Loss = 1.7274e-02, PNorm = 694.5774, GNorm = 1.2548, lr_0 = 9.9607e-04
Validation auc = 0.684114
Epoch 5801
Loss = 1.1198e-02, PNorm = 694.5965, GNorm = 1.6474, lr_0 = 9.9607e-04
Validation auc = 0.682281
Epoch 5802
Loss = 1.0653e-02, PNorm = 694.6158, GNorm = 0.1221, lr_0 = 9.9607e-04
Validation auc = 0.678910
Epoch 5803
Loss = 1.4351e-02, PNorm = 694.6465, GNorm = 0.6209, lr_0 = 9.9607e-04
Validation auc = 0.671647
Epoch 5804
Loss = 2.8061e-02, PNorm = 694.6767, GNorm = 0.2392, lr_0 = 9.9607e-04
Validation auc = 0.672268
Epoch 5805
Loss = 3.1136e-02, PNorm = 694.7052, GNorm = 0.5869, lr_0 = 9.9607e-04
Validation auc = 0.669562
Epoch 5806
Loss = 5.0908e-02, PNorm = 694.7360, GNorm = 0.6434, lr_0 = 9.9607e-04
Validation auc = 0.672340
Epoch 5807
Loss = 6.7875e-03, PNorm = 694.7693, GNorm = 0.7445, lr_0 = 9.9607e-04
Validation auc = 0.672151
Epoch 5808
Loss = 6.8341e-02, PNorm = 694.8068, GNorm = 1.4290, lr_0 = 9.9607e-04
Validation auc = 0.668103
Epoch 5809
Loss = 4.4394e-02, PNorm = 694.8529, GNorm = 4.4087, lr_0 = 9.9607e-04
Loss = 1.7190e-02, PNorm = 694.8918, GNorm = 0.3731, lr_0 = 9.9607e-04
Validation auc = 0.674602
Epoch 5810
Loss = 7.6126e-02, PNorm = 694.9253, GNorm = 0.1192, lr_0 = 9.9607e-04
Validation auc = 0.676606
Epoch 5811
Loss = 2.3924e-02, PNorm = 694.9602, GNorm = 3.9590, lr_0 = 9.9607e-04
Validation auc = 0.675302
Epoch 5812
Loss = 5.1617e-02, PNorm = 695.0067, GNorm = 1.6688, lr_0 = 9.9607e-04
Validation auc = 0.675963
Epoch 5813
Loss = 1.4732e-01, PNorm = 695.0869, GNorm = 2.6366, lr_0 = 9.9607e-04
Validation auc = 0.692072
Epoch 5814
Loss = 1.1764e-01, PNorm = 695.1610, GNorm = 0.5098, lr_0 = 9.9606e-04
Validation auc = 0.691708
Epoch 5815
Loss = 4.3769e-02, PNorm = 695.2355, GNorm = 2.6251, lr_0 = 9.9606e-04
Validation auc = 0.692332
Epoch 5816
Loss = 1.6584e-02, PNorm = 695.2990, GNorm = 1.1811, lr_0 = 9.9606e-04
Validation auc = 0.686146
Epoch 5817
Loss = 1.0383e-01, PNorm = 695.3402, GNorm = 3.9359, lr_0 = 9.9606e-04
Validation auc = 0.680564
Epoch 5818
Loss = 7.6183e-02, PNorm = 695.3770, GNorm = 0.5535, lr_0 = 9.9606e-04
Validation auc = 0.679106
Epoch 5819
Loss = 2.9345e-02, PNorm = 695.4281, GNorm = 1.2804, lr_0 = 9.9606e-04
Loss = 2.8420e-02, PNorm = 695.4892, GNorm = 0.3933, lr_0 = 9.9606e-04
Validation auc = 0.666404
Epoch 5820
Loss = 5.0253e-02, PNorm = 695.5391, GNorm = 0.1551, lr_0 = 9.9606e-04
Validation auc = 0.667510
Epoch 5821
Loss = 4.6548e-02, PNorm = 695.5825, GNorm = 0.2349, lr_0 = 9.9606e-04
Validation auc = 0.672858
Epoch 5822
Loss = 4.1923e-02, PNorm = 695.6155, GNorm = 1.6893, lr_0 = 9.9606e-04
Validation auc = 0.676239
Epoch 5823
Loss = 8.4749e-02, PNorm = 695.6587, GNorm = 14.7784, lr_0 = 9.9606e-04
Validation auc = 0.679143
Epoch 5824
Loss = 1.5405e-01, PNorm = 695.7236, GNorm = 20.1812, lr_0 = 9.9606e-04
Validation auc = 0.678243
Epoch 5825
Loss = 3.6171e-02, PNorm = 695.7775, GNorm = 1.2701, lr_0 = 9.9606e-04
Validation auc = 0.679931
Epoch 5826
Loss = 1.9955e-02, PNorm = 695.8328, GNorm = 1.0286, lr_0 = 9.9606e-04
Validation auc = 0.676156
Epoch 5827
Loss = 2.3950e-02, PNorm = 695.8898, GNorm = 1.5636, lr_0 = 9.9606e-04
Validation auc = 0.678544
Epoch 5828
Loss = 5.3437e-02, PNorm = 695.9439, GNorm = 1.7349, lr_0 = 9.9605e-04
Validation auc = 0.675257
Epoch 5829
Loss = 1.6204e-02, PNorm = 696.0098, GNorm = 0.5927, lr_0 = 9.9605e-04
Loss = 8.9909e-02, PNorm = 696.0806, GNorm = 0.5326, lr_0 = 9.9605e-04
Validation auc = 0.685593
Epoch 5830
Loss = 8.9182e-02, PNorm = 696.1443, GNorm = 7.0990, lr_0 = 9.9605e-04
Validation auc = 0.695836
Epoch 5831
Loss = 4.3078e-02, PNorm = 696.2062, GNorm = 0.6306, lr_0 = 9.9605e-04
Validation auc = 0.698181
Epoch 5832
Loss = 4.9005e-02, PNorm = 696.2602, GNorm = 2.0047, lr_0 = 9.9605e-04
Validation auc = 0.698583
Epoch 5833
Loss = 2.9327e-02, PNorm = 696.3098, GNorm = 3.0045, lr_0 = 9.9605e-04
Validation auc = 0.693925
Epoch 5834
Loss = 2.1477e-02, PNorm = 696.3519, GNorm = 1.9543, lr_0 = 9.9605e-04
Validation auc = 0.691536
Epoch 5835
Loss = 5.4289e-02, PNorm = 696.3935, GNorm = 4.3133, lr_0 = 9.9605e-04
Validation auc = 0.692429
Epoch 5836
Loss = 7.7218e-02, PNorm = 696.4491, GNorm = 2.5581, lr_0 = 9.9605e-04
Validation auc = 0.682247
Epoch 5837
Loss = 1.1222e-01, PNorm = 696.5040, GNorm = 0.8604, lr_0 = 9.9605e-04
Validation auc = 0.680380
Epoch 5838
Loss = 5.9550e-02, PNorm = 696.5553, GNorm = 0.7028, lr_0 = 9.9605e-04
Validation auc = 0.682582
Epoch 5839
Loss = 3.0158e-02, PNorm = 696.6056, GNorm = 1.6198, lr_0 = 9.9605e-04
Loss = 2.7751e-02, PNorm = 696.6529, GNorm = 1.5417, lr_0 = 9.9605e-04
Validation auc = 0.686205
Epoch 5840
Loss = 7.4904e-02, PNorm = 696.6968, GNorm = 1.5093, lr_0 = 9.9604e-04
Validation auc = 0.683711
Epoch 5841
Loss = 8.2313e-02, PNorm = 696.7532, GNorm = 2.9621, lr_0 = 9.9604e-04
Validation auc = 0.689994
Epoch 5842
Loss = 6.9622e-02, PNorm = 696.8207, GNorm = 5.2838, lr_0 = 9.9604e-04
Validation auc = 0.691113
Epoch 5843
Loss = 4.0176e-02, PNorm = 696.8823, GNorm = 0.3213, lr_0 = 9.9604e-04
Validation auc = 0.689117
Epoch 5844
Loss = 3.0162e-02, PNorm = 696.9220, GNorm = 6.7188, lr_0 = 9.9604e-04
Validation auc = 0.691647
Epoch 5845
Loss = 6.8185e-02, PNorm = 696.9604, GNorm = 0.8316, lr_0 = 9.9604e-04
Validation auc = 0.687041
Epoch 5846
Loss = 1.4386e-02, PNorm = 696.9982, GNorm = 1.0978, lr_0 = 9.9604e-04
Validation auc = 0.683060
Epoch 5847
Loss = 2.1899e-02, PNorm = 697.0272, GNorm = 0.9355, lr_0 = 9.9604e-04
Validation auc = 0.683269
Epoch 5848
Loss = 9.7135e-03, PNorm = 697.0516, GNorm = 0.1180, lr_0 = 9.9604e-04
Validation auc = 0.684327
Epoch 5849
Loss = 3.2446e-03, PNorm = 697.0737, GNorm = 0.1956, lr_0 = 9.9604e-04
Loss = 1.2324e-02, PNorm = 697.0962, GNorm = 2.8082, lr_0 = 9.9604e-04
Validation auc = 0.683800
Epoch 5850
Loss = 2.4476e-02, PNorm = 697.1173, GNorm = 1.1917, lr_0 = 9.9604e-04
Validation auc = 0.685496
Epoch 5851
Loss = 4.0254e-02, PNorm = 697.1453, GNorm = 0.8332, lr_0 = 9.9604e-04
Validation auc = 0.687226
Epoch 5852
Loss = 1.9235e-02, PNorm = 697.1789, GNorm = 0.4976, lr_0 = 9.9604e-04
Validation auc = 0.685780
Epoch 5853
Loss = 6.5060e-02, PNorm = 697.2150, GNorm = 0.2059, lr_0 = 9.9604e-04
Validation auc = 0.693865
Epoch 5854
Loss = 3.0039e-02, PNorm = 697.2652, GNorm = 0.0704, lr_0 = 9.9603e-04
Validation auc = 0.700940
Epoch 5855
Loss = 3.0143e-02, PNorm = 697.3032, GNorm = 1.4865, lr_0 = 9.9603e-04
Validation auc = 0.707039
Epoch 5856
Loss = 4.0382e-02, PNorm = 697.3408, GNorm = 1.9295, lr_0 = 9.9603e-04
Validation auc = 0.706453
Epoch 5857
Loss = 2.4632e-02, PNorm = 697.3841, GNorm = 3.2846, lr_0 = 9.9603e-04
Validation auc = 0.695666
Epoch 5858
Loss = 3.4646e-03, PNorm = 697.4320, GNorm = 0.2499, lr_0 = 9.9603e-04
Validation auc = 0.691718
Epoch 5859
Loss = 2.2116e-02, PNorm = 697.4742, GNorm = 1.0334, lr_0 = 9.9603e-04
Loss = 3.3072e-02, PNorm = 697.5120, GNorm = 0.3908, lr_0 = 9.9603e-04
Validation auc = 0.692571
Epoch 5860
Loss = 5.6022e-02, PNorm = 697.5471, GNorm = 3.4152, lr_0 = 9.9603e-04
Validation auc = 0.689540
Epoch 5861
Loss = 5.9324e-02, PNorm = 697.5951, GNorm = 0.2014, lr_0 = 9.9603e-04
Validation auc = 0.682851
Epoch 5862
Loss = 5.3579e-02, PNorm = 697.6359, GNorm = 1.8762, lr_0 = 9.9603e-04
Validation auc = 0.672360
Epoch 5863
Loss = 5.5994e-02, PNorm = 697.6748, GNorm = 1.5687, lr_0 = 9.9603e-04
Validation auc = 0.664607
Epoch 5864
Loss = 6.4061e-02, PNorm = 697.7105, GNorm = 1.7308, lr_0 = 9.9603e-04
Validation auc = 0.667136
Epoch 5865
Loss = 6.6350e-02, PNorm = 697.7580, GNorm = 1.3432, lr_0 = 9.9603e-04
Validation auc = 0.665875
Epoch 5866
Loss = 4.5247e-02, PNorm = 697.8042, GNorm = 3.1915, lr_0 = 9.9603e-04
Validation auc = 0.668738
Epoch 5867
Loss = 1.7431e-02, PNorm = 697.8505, GNorm = 0.5757, lr_0 = 9.9602e-04
Validation auc = 0.674964
Epoch 5868
Loss = 1.4639e-02, PNorm = 697.8847, GNorm = 1.0060, lr_0 = 9.9602e-04
Validation auc = 0.678984
Epoch 5869
Loss = 1.9884e-01, PNorm = 697.9131, GNorm = 4.1008, lr_0 = 9.9602e-04
Loss = 4.2168e-02, PNorm = 697.9464, GNorm = 2.6280, lr_0 = 9.9602e-04
Validation auc = 0.672518
Epoch 5870
Loss = 3.9874e-02, PNorm = 697.9930, GNorm = 0.7191, lr_0 = 9.9602e-04
Validation auc = 0.660886
Epoch 5871
Loss = 3.2508e-02, PNorm = 698.0506, GNorm = 0.2639, lr_0 = 9.9602e-04
Validation auc = 0.650236
Epoch 5872
Loss = 3.7514e-02, PNorm = 698.0983, GNorm = 0.4272, lr_0 = 9.9602e-04
Validation auc = 0.651010
Epoch 5873
Loss = 5.9921e-02, PNorm = 698.1354, GNorm = 1.5196, lr_0 = 9.9602e-04
Validation auc = 0.652631
Epoch 5874
Loss = 3.0456e-02, PNorm = 698.1776, GNorm = 1.7888, lr_0 = 9.9602e-04
Validation auc = 0.649806
Epoch 5875
Loss = 5.8208e-03, PNorm = 698.2169, GNorm = 0.0924, lr_0 = 9.9602e-04
Validation auc = 0.648813
Epoch 5876
Loss = 1.0794e-02, PNorm = 698.2469, GNorm = 0.2528, lr_0 = 9.9602e-04
Validation auc = 0.650503
Epoch 5877
Loss = 3.2778e-02, PNorm = 698.2744, GNorm = 0.5156, lr_0 = 9.9602e-04
Validation auc = 0.650052
Epoch 5878
Loss = 1.6400e-01, PNorm = 698.3324, GNorm = 6.4001, lr_0 = 9.9602e-04
Validation auc = 0.647452
Epoch 5879
Loss = 1.6000e-02, PNorm = 698.4220, GNorm = 0.7800, lr_0 = 9.9602e-04
Loss = 3.7837e-02, PNorm = 698.4871, GNorm = 2.0863, lr_0 = 9.9602e-04
Validation auc = 0.649130
Epoch 5880
Loss = 4.5431e-02, PNorm = 698.5361, GNorm = 0.6296, lr_0 = 9.9601e-04
Validation auc = 0.660627
Epoch 5881
Loss = 6.5110e-02, PNorm = 698.5715, GNorm = 10.3258, lr_0 = 9.9601e-04
Validation auc = 0.667824
Epoch 5882
Loss = 5.6338e-02, PNorm = 698.6208, GNorm = 0.7075, lr_0 = 9.9601e-04
Validation auc = 0.678178
Epoch 5883
Loss = 4.2373e-02, PNorm = 698.6849, GNorm = 2.1188, lr_0 = 9.9601e-04
Validation auc = 0.675913
Epoch 5884
Loss = 1.0160e-01, PNorm = 698.7541, GNorm = 1.3180, lr_0 = 9.9601e-04
Validation auc = 0.664761
Epoch 5885
Loss = 1.4018e-01, PNorm = 698.8223, GNorm = 1.1322, lr_0 = 9.9601e-04
Validation auc = 0.655701
Epoch 5886
Loss = 4.2559e-02, PNorm = 698.8847, GNorm = 1.0429, lr_0 = 9.9601e-04
Validation auc = 0.657191
Epoch 5887
Loss = 2.0925e-02, PNorm = 698.9328, GNorm = 1.4501, lr_0 = 9.9601e-04
Validation auc = 0.670871
Epoch 5888
Loss = 2.0342e-02, PNorm = 698.9771, GNorm = 0.4966, lr_0 = 9.9601e-04
Validation auc = 0.683936
Epoch 5889
Loss = 3.4816e-02, PNorm = 699.0237, GNorm = 1.5191, lr_0 = 9.9601e-04
Loss = 4.5488e-02, PNorm = 699.0785, GNorm = 1.6892, lr_0 = 9.9601e-04
Validation auc = 0.689570
Epoch 5890
Loss = 5.1316e-02, PNorm = 699.1428, GNorm = 3.6938, lr_0 = 9.9601e-04
Validation auc = 0.697650
Epoch 5891
Loss = 7.7292e-02, PNorm = 699.2023, GNorm = 3.3970, lr_0 = 9.9601e-04
Validation auc = 0.687728
Epoch 5892
Loss = 5.2016e-02, PNorm = 699.2519, GNorm = 0.4860, lr_0 = 9.9601e-04
Validation auc = 0.681777
Epoch 5893
Loss = 9.0589e-02, PNorm = 699.2962, GNorm = 0.4681, lr_0 = 9.9600e-04
Validation auc = 0.682223
Epoch 5894
Loss = 2.0103e-02, PNorm = 699.3409, GNorm = 0.3532, lr_0 = 9.9600e-04
Validation auc = 0.686460
Epoch 5895
Loss = 3.0123e-02, PNorm = 699.3764, GNorm = 0.3013, lr_0 = 9.9600e-04
Validation auc = 0.687642
Epoch 5896
Loss = 2.9678e-02, PNorm = 699.4064, GNorm = 0.2364, lr_0 = 9.9600e-04
Validation auc = 0.687666
Epoch 5897
Loss = 4.2116e-02, PNorm = 699.4330, GNorm = 0.6244, lr_0 = 9.9600e-04
Validation auc = 0.687840
Epoch 5898
Loss = 1.1811e-02, PNorm = 699.4668, GNorm = 1.4483, lr_0 = 9.9600e-04
Validation auc = 0.687271
Epoch 5899
Loss = 1.1503e-01, PNorm = 699.5349, GNorm = 3.7510, lr_0 = 9.9600e-04
Loss = 3.6649e-02, PNorm = 699.5979, GNorm = 0.1670, lr_0 = 9.9600e-04
Validation auc = 0.684195
Epoch 5900
Loss = 4.6712e-02, PNorm = 699.6522, GNorm = 1.0858, lr_0 = 9.9600e-04
Validation auc = 0.683278
Epoch 5901
Loss = 1.0228e-01, PNorm = 699.7107, GNorm = 1.3411, lr_0 = 9.9600e-04
Validation auc = 0.679767
Epoch 5902
Loss = 3.5084e-02, PNorm = 699.7769, GNorm = 3.8757, lr_0 = 9.9600e-04
Validation auc = 0.674916
Epoch 5903
Loss = 5.5082e-02, PNorm = 699.8305, GNorm = 0.8172, lr_0 = 9.9600e-04
Validation auc = 0.675658
Epoch 5904
Loss = 3.6764e-02, PNorm = 699.8736, GNorm = 3.7519, lr_0 = 9.9600e-04
Validation auc = 0.676613
Epoch 5905
Loss = 6.4497e-02, PNorm = 699.9154, GNorm = 0.9243, lr_0 = 9.9600e-04
Validation auc = 0.683810
Epoch 5906
Loss = 3.6602e-02, PNorm = 699.9719, GNorm = 1.9980, lr_0 = 9.9600e-04
Validation auc = 0.691063
Epoch 5907
Loss = 1.6133e-02, PNorm = 700.0224, GNorm = 2.1500, lr_0 = 9.9599e-04
Validation auc = 0.689065
Epoch 5908
Loss = 1.2301e-02, PNorm = 700.0626, GNorm = 2.9430, lr_0 = 9.9599e-04
Validation auc = 0.686801
Epoch 5909
Loss = 1.7820e-02, PNorm = 700.0987, GNorm = 1.5140, lr_0 = 9.9599e-04
Loss = 3.3926e-02, PNorm = 700.1449, GNorm = 3.2985, lr_0 = 9.9599e-04
Validation auc = 0.689836
Epoch 5910
Loss = 5.4186e-02, PNorm = 700.1933, GNorm = 4.7948, lr_0 = 9.9599e-04
Validation auc = 0.697159
Epoch 5911
Loss = 6.5679e-02, PNorm = 700.2505, GNorm = 0.1444, lr_0 = 9.9599e-04
Validation auc = 0.698290
Epoch 5912
Loss = 2.9887e-02, PNorm = 700.3085, GNorm = 0.2471, lr_0 = 9.9599e-04
Validation auc = 0.694685
Epoch 5913
Loss = 2.6856e-02, PNorm = 700.3451, GNorm = 1.8389, lr_0 = 9.9599e-04
Validation auc = 0.693749
Epoch 5914
Loss = 2.5546e-02, PNorm = 700.3820, GNorm = 3.3562, lr_0 = 9.9599e-04
Validation auc = 0.692364
Epoch 5915
Loss = 2.6569e-02, PNorm = 700.4226, GNorm = 2.7026, lr_0 = 9.9599e-04
Validation auc = 0.704198
Epoch 5916
Loss = 4.1284e-02, PNorm = 700.4597, GNorm = 3.0475, lr_0 = 9.9599e-04
Validation auc = 0.707604
Epoch 5917
Loss = 8.7406e-03, PNorm = 700.4998, GNorm = 0.6254, lr_0 = 9.9599e-04
Validation auc = 0.709876
Epoch 5918
Loss = 4.5593e-02, PNorm = 700.5453, GNorm = 3.3556, lr_0 = 9.9599e-04
Validation auc = 0.713424
Epoch 5919
Loss = 1.4824e-02, PNorm = 700.5906, GNorm = 1.1204, lr_0 = 9.9599e-04
Loss = 1.3519e-02, PNorm = 700.6300, GNorm = 0.2462, lr_0 = 9.9599e-04
Validation auc = 0.715393
Epoch 5920
Loss = 6.2867e-02, PNorm = 700.6665, GNorm = 2.3434, lr_0 = 9.9598e-04
Validation auc = 0.713951
Epoch 5921
Loss = 5.0032e-02, PNorm = 700.7305, GNorm = 1.1043, lr_0 = 9.9598e-04
Validation auc = 0.712989
Epoch 5922
Loss = 2.8864e-02, PNorm = 700.7828, GNorm = 0.4496, lr_0 = 9.9598e-04
Validation auc = 0.710551
Epoch 5923
Loss = 7.4461e-02, PNorm = 700.8251, GNorm = 5.3636, lr_0 = 9.9598e-04
Validation auc = 0.705465
Epoch 5924
Loss = 7.4380e-02, PNorm = 700.8729, GNorm = 2.0143, lr_0 = 9.9598e-04
Validation auc = 0.695443
Epoch 5925
Loss = 1.4360e-02, PNorm = 700.9156, GNorm = 0.3923, lr_0 = 9.9598e-04
Validation auc = 0.688376
Epoch 5926
Loss = 6.2918e-03, PNorm = 700.9463, GNorm = 0.1804, lr_0 = 9.9598e-04
Validation auc = 0.694436
Epoch 5927
Loss = 7.0754e-02, PNorm = 700.9818, GNorm = 2.4599, lr_0 = 9.9598e-04
Validation auc = 0.699408
Epoch 5928
Loss = 1.6899e-02, PNorm = 701.0313, GNorm = 0.8347, lr_0 = 9.9598e-04
Validation auc = 0.699073
Epoch 5929
Loss = 8.6417e-03, PNorm = 701.0778, GNorm = 0.8934, lr_0 = 9.9598e-04
Loss = 2.6865e-02, PNorm = 701.1206, GNorm = 0.4565, lr_0 = 9.9598e-04
Validation auc = 0.706350
Epoch 5930
Loss = 3.2045e-02, PNorm = 701.1574, GNorm = 1.8457, lr_0 = 9.9598e-04
Validation auc = 0.710886
Epoch 5931
Loss = 3.3879e-02, PNorm = 701.1849, GNorm = 0.1102, lr_0 = 9.9598e-04
Validation auc = 0.709146
Epoch 5932
Loss = 9.5240e-03, PNorm = 701.2082, GNorm = 1.1861, lr_0 = 9.9598e-04
Validation auc = 0.708166
Epoch 5933
Loss = 3.6334e-02, PNorm = 701.2300, GNorm = 1.2423, lr_0 = 9.9597e-04
Validation auc = 0.704139
Epoch 5934
Loss = 1.9986e-02, PNorm = 701.2584, GNorm = 8.3165, lr_0 = 9.9597e-04
Validation auc = 0.694949
Epoch 5935
Loss = 4.9214e-02, PNorm = 701.2961, GNorm = 1.5619, lr_0 = 9.9597e-04
Validation auc = 0.692303
Epoch 5936
Loss = 4.4812e-02, PNorm = 701.3421, GNorm = 0.4895, lr_0 = 9.9597e-04
Validation auc = 0.686947
Epoch 5937
Loss = 3.0766e-02, PNorm = 701.3926, GNorm = 0.1788, lr_0 = 9.9597e-04
Validation auc = 0.687682
Epoch 5938
Loss = 4.7963e-02, PNorm = 701.4360, GNorm = 0.3320, lr_0 = 9.9597e-04
Validation auc = 0.690324
Epoch 5939
Loss = 2.6578e-01, PNorm = 701.4833, GNorm = 6.4159, lr_0 = 9.9597e-04
Loss = 1.9522e-02, PNorm = 701.5296, GNorm = 2.7244, lr_0 = 9.9597e-04
Validation auc = 0.695143
Epoch 5940
Loss = 1.4664e-02, PNorm = 701.5678, GNorm = 0.7156, lr_0 = 9.9597e-04
Validation auc = 0.695527
Epoch 5941
Loss = 1.1295e-01, PNorm = 701.6026, GNorm = 3.3798, lr_0 = 9.9597e-04
Validation auc = 0.691283
Epoch 5942
Loss = 4.3565e-02, PNorm = 701.6515, GNorm = 2.4705, lr_0 = 9.9597e-04
Validation auc = 0.694740
Epoch 5943
Loss = 6.3411e-02, PNorm = 701.7041, GNorm = 1.4900, lr_0 = 9.9597e-04
Validation auc = 0.687108
Epoch 5944
Loss = 3.6616e-02, PNorm = 701.7593, GNorm = 2.9692, lr_0 = 9.9597e-04
Validation auc = 0.688249
Epoch 5945
Loss = 2.0429e-02, PNorm = 701.8108, GNorm = 1.4285, lr_0 = 9.9597e-04
Validation auc = 0.687884
Epoch 5946
Loss = 5.9681e-02, PNorm = 701.8547, GNorm = 6.9791, lr_0 = 9.9597e-04
Validation auc = 0.692929
Epoch 5947
Loss = 2.0293e-02, PNorm = 701.9222, GNorm = 0.0494, lr_0 = 9.9596e-04
Validation auc = 0.698560
Epoch 5948
Loss = 8.6385e-03, PNorm = 702.0037, GNorm = 0.9810, lr_0 = 9.9596e-04
Validation auc = 0.700700
Epoch 5949
Loss = 1.5420e-01, PNorm = 702.0870, GNorm = 5.0582, lr_0 = 9.9596e-04
Loss = 2.9008e-02, PNorm = 702.1536, GNorm = 1.5486, lr_0 = 9.9596e-04
Validation auc = 0.699935
Epoch 5950
Loss = 4.5066e-02, PNorm = 702.1974, GNorm = 15.1616, lr_0 = 9.9596e-04
Validation auc = 0.698736
Epoch 5951
Loss = 2.3906e-02, PNorm = 702.2471, GNorm = 2.0740, lr_0 = 9.9596e-04
Validation auc = 0.695958
Epoch 5952
Loss = 8.3048e-02, PNorm = 702.3030, GNorm = 0.5681, lr_0 = 9.9596e-04
Validation auc = 0.678566
Epoch 5953
Loss = 6.1408e-02, PNorm = 702.3586, GNorm = 1.0602, lr_0 = 9.9596e-04
Validation auc = 0.675688
Epoch 5954
Loss = 6.5666e-02, PNorm = 702.4106, GNorm = 2.0680, lr_0 = 9.9596e-04
Validation auc = 0.677206
Epoch 5955
Loss = 2.1719e-02, PNorm = 702.4560, GNorm = 0.9635, lr_0 = 9.9596e-04
Validation auc = 0.679005
Epoch 5956
Loss = 1.5325e-01, PNorm = 702.4918, GNorm = 0.7785, lr_0 = 9.9596e-04
Validation auc = 0.682887
Epoch 5957
Loss = 9.3692e-02, PNorm = 702.5353, GNorm = 0.1411, lr_0 = 9.9596e-04
Validation auc = 0.681870
Epoch 5958
Loss = 8.4223e-02, PNorm = 702.5987, GNorm = 0.6594, lr_0 = 9.9596e-04
Validation auc = 0.681279
Epoch 5959
Loss = 2.2518e-02, PNorm = 702.6554, GNorm = 1.2761, lr_0 = 9.9596e-04
Loss = 7.6818e-02, PNorm = 702.6938, GNorm = 15.2459, lr_0 = 9.9595e-04
Validation auc = 0.682892
Epoch 5960
Loss = 2.4717e-02, PNorm = 702.7408, GNorm = 2.2477, lr_0 = 9.9595e-04
Validation auc = 0.686110
Epoch 5961
Loss = 4.4524e-02, PNorm = 702.7861, GNorm = 1.9611, lr_0 = 9.9595e-04
Validation auc = 0.684655
Epoch 5962
Loss = 3.7087e-02, PNorm = 702.8319, GNorm = 0.4566, lr_0 = 9.9595e-04
Validation auc = 0.690487
Epoch 5963
Loss = 3.3359e-02, PNorm = 702.8760, GNorm = 2.6800, lr_0 = 9.9595e-04
Validation auc = 0.699472
Epoch 5964
Loss = 5.8551e-02, PNorm = 702.9124, GNorm = 2.2932, lr_0 = 9.9595e-04
Validation auc = 0.703294
Epoch 5965
Loss = 6.4373e-02, PNorm = 702.9505, GNorm = 1.8254, lr_0 = 9.9595e-04
Validation auc = 0.700309
Epoch 5966
Loss = 5.6488e-02, PNorm = 703.0032, GNorm = 4.3865, lr_0 = 9.9595e-04
Validation auc = 0.702369
Epoch 5967
Loss = 3.3068e-02, PNorm = 703.0618, GNorm = 19.9195, lr_0 = 9.9595e-04
Validation auc = 0.711797
Epoch 5968
Loss = 1.3718e-01, PNorm = 703.1326, GNorm = 9.9478, lr_0 = 9.9595e-04
Validation auc = 0.705996
Epoch 5969
Loss = 3.0336e-02, PNorm = 703.2062, GNorm = 3.2155, lr_0 = 9.9595e-04
Loss = 3.5945e-02, PNorm = 703.2870, GNorm = 0.5668, lr_0 = 9.9595e-04
Validation auc = 0.700573
Epoch 5970
Loss = 8.6952e-02, PNorm = 703.3605, GNorm = 10.1627, lr_0 = 9.9595e-04
Validation auc = 0.691204
Epoch 5971
Loss = 4.6150e-02, PNorm = 703.4286, GNorm = 6.0617, lr_0 = 9.9595e-04
Validation auc = 0.683120
Epoch 5972
Loss = 2.7766e-02, PNorm = 703.4908, GNorm = 1.0085, lr_0 = 9.9595e-04
Validation auc = 0.678265
Epoch 5973
Loss = 3.3227e-02, PNorm = 703.5398, GNorm = 0.0645, lr_0 = 9.9594e-04
Validation auc = 0.669686
Epoch 5974
Loss = 3.1626e-02, PNorm = 703.5880, GNorm = 5.6424, lr_0 = 9.9594e-04
Validation auc = 0.671802
Epoch 5975
Loss = 3.6007e-02, PNorm = 703.6405, GNorm = 0.1628, lr_0 = 9.9594e-04
Validation auc = 0.675023
Epoch 5976
Loss = 5.2332e-02, PNorm = 703.6961, GNorm = 0.7734, lr_0 = 9.9594e-04
Validation auc = 0.679589
Epoch 5977
Loss = 8.7796e-02, PNorm = 703.7552, GNorm = 5.1151, lr_0 = 9.9594e-04
Validation auc = 0.678954
Epoch 5978
Loss = 1.3502e-02, PNorm = 703.8102, GNorm = 0.6029, lr_0 = 9.9594e-04
Validation auc = 0.674854
Epoch 5979
Loss = 1.2352e-01, PNorm = 703.8613, GNorm = 3.5356, lr_0 = 9.9594e-04
Loss = 3.5243e-02, PNorm = 703.9011, GNorm = 0.3338, lr_0 = 9.9594e-04
Validation auc = 0.674300
Epoch 5980
Loss = 2.2805e-02, PNorm = 703.9324, GNorm = 0.7677, lr_0 = 9.9594e-04
Validation auc = 0.674165
Epoch 5981
Loss = 3.4358e-02, PNorm = 703.9582, GNorm = 1.1027, lr_0 = 9.9594e-04
Validation auc = 0.673521
Epoch 5982
Loss = 7.9763e-02, PNorm = 703.9947, GNorm = 2.1155, lr_0 = 9.9594e-04
Validation auc = 0.677972
Epoch 5983
Loss = 1.0052e-01, PNorm = 704.0384, GNorm = 2.0768, lr_0 = 9.9594e-04
Validation auc = 0.681778
Epoch 5984
Loss = 4.8348e-02, PNorm = 704.0882, GNorm = 1.1119, lr_0 = 9.9594e-04
Validation auc = 0.680608
Epoch 5985
Loss = 7.9446e-02, PNorm = 704.1405, GNorm = 4.9403, lr_0 = 9.9594e-04
Validation auc = 0.686314
Epoch 5986
Loss = 8.5801e-02, PNorm = 704.1972, GNorm = 5.8445, lr_0 = 9.9594e-04
Validation auc = 0.689585
Epoch 5987
Loss = 1.9775e-02, PNorm = 704.2536, GNorm = 1.0000, lr_0 = 9.9593e-04
Validation auc = 0.690356
Epoch 5988
Loss = 3.8369e-02, PNorm = 704.3056, GNorm = 0.4192, lr_0 = 9.9593e-04
Validation auc = 0.681335
Epoch 5989
Loss = 1.3542e-01, PNorm = 704.3621, GNorm = 4.0469, lr_0 = 9.9593e-04
Loss = 6.0032e-02, PNorm = 704.4159, GNorm = 3.0901, lr_0 = 9.9593e-04
Validation auc = 0.681606
Epoch 5990
Loss = 4.0428e-02, PNorm = 704.4680, GNorm = 3.0237, lr_0 = 9.9593e-04
Validation auc = 0.682456
Epoch 5991
Loss = 2.4763e-02, PNorm = 704.5166, GNorm = 1.1460, lr_0 = 9.9593e-04
Validation auc = 0.686850
Epoch 5992
Loss = 1.0018e-01, PNorm = 704.5751, GNorm = 1.2103, lr_0 = 9.9593e-04
Validation auc = 0.688151
Epoch 5993
Loss = 9.1492e-02, PNorm = 704.6389, GNorm = 3.6392, lr_0 = 9.9593e-04
Validation auc = 0.691759
Epoch 5994
Loss = 4.4280e-02, PNorm = 704.6952, GNorm = 3.5220, lr_0 = 9.9593e-04
Validation auc = 0.684555
Epoch 5995
Loss = 6.4031e-02, PNorm = 704.7468, GNorm = 0.9028, lr_0 = 9.9593e-04
Validation auc = 0.693249
Epoch 5996
Loss = 3.8610e-02, PNorm = 704.8063, GNorm = 3.0954, lr_0 = 9.9593e-04
Validation auc = 0.700885
Epoch 5997
Loss = 1.7177e-02, PNorm = 704.8692, GNorm = 0.9744, lr_0 = 9.9593e-04
Validation auc = 0.699638
Epoch 5998
Loss = 2.4723e-02, PNorm = 704.9290, GNorm = 0.7012, lr_0 = 9.9593e-04
Validation auc = 0.697289
Epoch 5999
Loss = 3.5704e-03, PNorm = 704.9770, GNorm = 0.2111, lr_0 = 9.9593e-04
Loss = 4.3754e-02, PNorm = 705.0265, GNorm = 1.7011, lr_0 = 9.9592e-04
Validation auc = 0.684672
Epoch 6000
Loss = 5.8179e-02, PNorm = 705.0812, GNorm = 0.2505, lr_0 = 9.9592e-04
Validation auc = 0.678703
Epoch 6001
Loss = 5.8945e-02, PNorm = 705.1313, GNorm = 3.4328, lr_0 = 9.9592e-04
Validation auc = 0.671735
Epoch 6002
Loss = 5.6670e-02, PNorm = 705.1961, GNorm = 3.3249, lr_0 = 9.9592e-04
Validation auc = 0.667480
Epoch 6003
Loss = 3.0537e-02, PNorm = 705.2644, GNorm = 1.7743, lr_0 = 9.9592e-04
Validation auc = 0.662723
Epoch 6004
Loss = 2.0945e-02, PNorm = 705.3161, GNorm = 3.3221, lr_0 = 9.9592e-04
Validation auc = 0.662872
Epoch 6005
Loss = 5.6298e-02, PNorm = 705.3593, GNorm = 1.1185, lr_0 = 9.9592e-04
Validation auc = 0.664058
Epoch 6006
Loss = 3.5411e-02, PNorm = 705.4106, GNorm = 3.2121, lr_0 = 9.9592e-04
Validation auc = 0.666874
Epoch 6007
Loss = 1.2825e-02, PNorm = 705.4620, GNorm = 0.6523, lr_0 = 9.9592e-04
Validation auc = 0.665827
Epoch 6008
Loss = 1.1769e-02, PNorm = 705.5046, GNorm = 1.3057, lr_0 = 9.9592e-04
Validation auc = 0.670395
Epoch 6009
Loss = 4.7586e-02, PNorm = 705.5679, GNorm = 1.9263, lr_0 = 9.9592e-04
Loss = 5.4526e-02, PNorm = 705.6457, GNorm = 7.1058, lr_0 = 9.9592e-04
Validation auc = 0.674367
Epoch 6010
Loss = 4.2685e-02, PNorm = 705.7114, GNorm = 3.4828, lr_0 = 9.9592e-04
Validation auc = 0.676758
Epoch 6011
Loss = 6.1641e-02, PNorm = 705.7718, GNorm = 3.0646, lr_0 = 9.9592e-04
Validation auc = 0.680995
Epoch 6012
Loss = 2.8726e-02, PNorm = 705.8276, GNorm = 2.0101, lr_0 = 9.9592e-04
Validation auc = 0.683614
Epoch 6013
Loss = 4.7073e-02, PNorm = 705.8909, GNorm = 0.2347, lr_0 = 9.9591e-04
Validation auc = 0.682215
Epoch 6014
Loss = 3.7785e-02, PNorm = 705.9547, GNorm = 0.7063, lr_0 = 9.9591e-04
Validation auc = 0.675099
Epoch 6015
Loss = 2.8155e-02, PNorm = 706.0164, GNorm = 1.5834, lr_0 = 9.9591e-04
Validation auc = 0.670720
Epoch 6016
Loss = 2.7160e-02, PNorm = 706.0855, GNorm = 1.8047, lr_0 = 9.9591e-04
Validation auc = 0.671245
Epoch 6017
Loss = 4.9330e-02, PNorm = 706.1444, GNorm = 0.3207, lr_0 = 9.9591e-04
Validation auc = 0.676629
Epoch 6018
Loss = 6.6542e-02, PNorm = 706.2069, GNorm = 1.8517, lr_0 = 9.9591e-04
Validation auc = 0.684432
Epoch 6019
Loss = 1.1324e-01, PNorm = 706.2742, GNorm = 3.3306, lr_0 = 9.9591e-04
Loss = 3.9983e-02, PNorm = 706.3317, GNorm = 3.3734, lr_0 = 9.9591e-04
Validation auc = 0.689874
Epoch 6020
Loss = 4.5754e-01, PNorm = 706.4330, GNorm = 2.2505, lr_0 = 9.9591e-04
Validation auc = 0.700419
Epoch 6021
Loss = 1.9104e-01, PNorm = 706.5474, GNorm = 6.4917, lr_0 = 9.9591e-04
Validation auc = 0.696481
Epoch 6022
Loss = 1.1171e-01, PNorm = 706.6684, GNorm = 5.7640, lr_0 = 9.9591e-04
Validation auc = 0.695551
Epoch 6023
Loss = 9.6228e-02, PNorm = 706.7747, GNorm = 3.9061, lr_0 = 9.9591e-04
Validation auc = 0.696484
Epoch 6024
Loss = 1.7775e-01, PNorm = 706.8841, GNorm = 1.3052, lr_0 = 9.9591e-04
Validation auc = 0.685676
Epoch 6025
Loss = 5.2520e-02, PNorm = 706.9997, GNorm = 1.6011, lr_0 = 9.9591e-04
Validation auc = 0.681401
Epoch 6026
Loss = 6.5369e-02, PNorm = 707.0779, GNorm = 2.2520, lr_0 = 9.9590e-04
Validation auc = 0.677849
Epoch 6027
Loss = 8.2009e-02, PNorm = 707.1429, GNorm = 7.1631, lr_0 = 9.9590e-04
Validation auc = 0.682170
Epoch 6028
Loss = 8.3802e-02, PNorm = 707.2160, GNorm = 1.9045, lr_0 = 9.9590e-04
Validation auc = 0.693263
Epoch 6029
Loss = 1.0217e+00, PNorm = 707.3777, GNorm = 228.9116, lr_0 = 9.9590e-04
Loss = 1.2657e-01, PNorm = 707.9435, GNorm = 3.7621, lr_0 = 9.9590e-04
Validation auc = 0.725256
Epoch 6030
Loss = 4.3798e-01, PNorm = 708.3332, GNorm = 9.8431, lr_0 = 9.9590e-04
Validation auc = 0.721609
Epoch 6031
Loss = 1.9591e-01, PNorm = 708.5918, GNorm = 4.5725, lr_0 = 9.9590e-04
Validation auc = 0.717804
Epoch 6032
Loss = 1.1888e-01, PNorm = 708.7481, GNorm = 5.9723, lr_0 = 9.9590e-04
Validation auc = 0.720356
Epoch 6033
Loss = 2.1569e-01, PNorm = 708.8768, GNorm = 2.8876, lr_0 = 9.9590e-04
Validation auc = 0.719120
Epoch 6034
Loss = 2.9880e-01, PNorm = 709.0041, GNorm = 4.4725, lr_0 = 9.9590e-04
Validation auc = 0.723587
Epoch 6035
Loss = 5.9070e-02, PNorm = 709.1244, GNorm = 2.1452, lr_0 = 9.9590e-04
Validation auc = 0.719353
Epoch 6036
Loss = 9.1734e-02, PNorm = 709.2095, GNorm = 6.5364, lr_0 = 9.9590e-04
Validation auc = 0.723513
Epoch 6037
Loss = 1.1402e-01, PNorm = 709.2892, GNorm = 6.8829, lr_0 = 9.9590e-04
Validation auc = 0.730880
Epoch 6038
Loss = 1.1732e-01, PNorm = 709.3686, GNorm = 1.8607, lr_0 = 9.9590e-04
Validation auc = 0.726737
Epoch 6039
Loss = 6.9816e-02, PNorm = 709.4297, GNorm = 4.0539, lr_0 = 9.9590e-04
Loss = 1.3216e-01, PNorm = 709.4932, GNorm = 1.3584, lr_0 = 9.9589e-04
Validation auc = 0.714599
Epoch 6040
Loss = 6.2001e-02, PNorm = 709.5477, GNorm = 4.2110, lr_0 = 9.9589e-04
Validation auc = 0.714605
Epoch 6041
Loss = 5.3138e-02, PNorm = 709.6032, GNorm = 1.3859, lr_0 = 9.9589e-04
Validation auc = 0.719167
Epoch 6042
Loss = 8.0929e-02, PNorm = 709.6593, GNorm = 1.8501, lr_0 = 9.9589e-04
Validation auc = 0.725543
Epoch 6043
Loss = 7.1048e-02, PNorm = 709.7058, GNorm = 0.7744, lr_0 = 9.9589e-04
Validation auc = 0.723694
Epoch 6044
Loss = 4.5177e-02, PNorm = 709.7415, GNorm = 1.0282, lr_0 = 9.9589e-04
Validation auc = 0.722875
Epoch 6045
Loss = 8.6603e-02, PNorm = 709.7741, GNorm = 1.1147, lr_0 = 9.9589e-04
Validation auc = 0.720594
Epoch 6046
Loss = 8.2132e-02, PNorm = 709.8057, GNorm = 3.8336, lr_0 = 9.9589e-04
Validation auc = 0.713553
Epoch 6047
Loss = 9.3205e-02, PNorm = 709.8479, GNorm = 1.2414, lr_0 = 9.9589e-04
Validation auc = 0.709627
Epoch 6048
Loss = 8.0012e-02, PNorm = 709.8950, GNorm = 4.7721, lr_0 = 9.9589e-04
Validation auc = 0.711304
Epoch 6049
Loss = 7.9532e-02, PNorm = 709.9419, GNorm = 4.4087, lr_0 = 9.9589e-04
Loss = 8.7263e-02, PNorm = 709.9833, GNorm = 2.1419, lr_0 = 9.9589e-04
Validation auc = 0.714368
Epoch 6050
Loss = 9.2908e-02, PNorm = 710.0364, GNorm = 1.5255, lr_0 = 9.9589e-04
Validation auc = 0.710825
Epoch 6051
Loss = 4.2390e-02, PNorm = 710.0894, GNorm = 6.2869, lr_0 = 9.9589e-04
Validation auc = 0.701613
Epoch 6052
Loss = 9.4984e-02, PNorm = 710.1429, GNorm = 3.3970, lr_0 = 9.9588e-04
Validation auc = 0.687740
Epoch 6053
Loss = 8.5421e-02, PNorm = 710.2050, GNorm = 3.4621, lr_0 = 9.9588e-04
Validation auc = 0.680469
Epoch 6054
Loss = 7.0549e-02, PNorm = 710.2661, GNorm = 1.3425, lr_0 = 9.9588e-04
Validation auc = 0.688391
Epoch 6055
Loss = 1.1293e-01, PNorm = 710.3181, GNorm = 1.0890, lr_0 = 9.9588e-04
Validation auc = 0.696575
Epoch 6056
Loss = 8.2178e-02, PNorm = 710.3739, GNorm = 0.7731, lr_0 = 9.9588e-04
Validation auc = 0.710190
Epoch 6057
Loss = 2.9813e-02, PNorm = 710.4429, GNorm = 2.4476, lr_0 = 9.9588e-04
Validation auc = 0.714739
Epoch 6058
Loss = 6.1842e-02, PNorm = 710.4969, GNorm = 1.7914, lr_0 = 9.9588e-04
Validation auc = 0.709400
Epoch 6059
Loss = 4.2111e-03, PNorm = 710.5350, GNorm = 0.2629, lr_0 = 9.9588e-04
Loss = 4.0092e-02, PNorm = 710.5713, GNorm = 0.6337, lr_0 = 9.9588e-04
Validation auc = 0.705466
Epoch 6060
Loss = 3.1208e-02, PNorm = 710.6036, GNorm = 3.2572, lr_0 = 9.9588e-04
Validation auc = 0.705875
Epoch 6061
Loss = 8.2379e-02, PNorm = 710.6328, GNorm = 8.9845, lr_0 = 9.9588e-04
Validation auc = 0.697886
Epoch 6062
Loss = 7.9869e-02, PNorm = 710.6731, GNorm = 2.3497, lr_0 = 9.9588e-04
Validation auc = 0.685818
Epoch 6063
Loss = 8.3801e-02, PNorm = 710.7138, GNorm = 5.3982, lr_0 = 9.9588e-04
Validation auc = 0.682463
Epoch 6064
Loss = 5.3696e-02, PNorm = 710.7548, GNorm = 1.8423, lr_0 = 9.9588e-04
Validation auc = 0.680751
Epoch 6065
Loss = 3.2048e-02, PNorm = 710.7912, GNorm = 0.6651, lr_0 = 9.9588e-04
Validation auc = 0.680279
Epoch 6066
Loss = 2.8943e-02, PNorm = 710.8319, GNorm = 2.0857, lr_0 = 9.9587e-04
Validation auc = 0.688294
Epoch 6067
Loss = 2.5570e-02, PNorm = 710.8697, GNorm = 0.1150, lr_0 = 9.9587e-04
Validation auc = 0.691334
Epoch 6068
Loss = 3.1345e-02, PNorm = 710.9038, GNorm = 1.8135, lr_0 = 9.9587e-04
Validation auc = 0.689513
Epoch 6069
Loss = 6.5528e-02, PNorm = 710.9549, GNorm = 1.7970, lr_0 = 9.9587e-04
Loss = 6.4813e-02, PNorm = 711.0145, GNorm = 3.9687, lr_0 = 9.9587e-04
Validation auc = 0.696870
Epoch 6070
Loss = 7.0383e-02, PNorm = 711.0739, GNorm = 2.3678, lr_0 = 9.9587e-04
Validation auc = 0.695336
Epoch 6071
Loss = 4.7843e-02, PNorm = 711.1214, GNorm = 1.6430, lr_0 = 9.9587e-04
Validation auc = 0.695196
Epoch 6072
Loss = 5.1244e-02, PNorm = 711.1593, GNorm = 1.7609, lr_0 = 9.9587e-04
Validation auc = 0.696169
Epoch 6073
Loss = 1.0592e-01, PNorm = 711.2453, GNorm = 6.0272, lr_0 = 9.9587e-04
Validation auc = 0.692552
Epoch 6074
Loss = 1.3030e-01, PNorm = 711.3317, GNorm = 0.3237, lr_0 = 9.9587e-04
Validation auc = 0.691165
Epoch 6075
Loss = 7.3986e-02, PNorm = 711.4159, GNorm = 0.7141, lr_0 = 9.9587e-04
Validation auc = 0.688639
Epoch 6076
Loss = 5.6645e-02, PNorm = 711.4839, GNorm = 2.7466, lr_0 = 9.9587e-04
Validation auc = 0.686918
Epoch 6077
Loss = 7.7519e-02, PNorm = 711.5338, GNorm = 2.8071, lr_0 = 9.9587e-04
Validation auc = 0.689472
Epoch 6078
Loss = 1.4933e-01, PNorm = 711.5849, GNorm = 4.4921, lr_0 = 9.9587e-04
Validation auc = 0.690718
Epoch 6079
Loss = 1.9238e-02, PNorm = 711.6436, GNorm = 1.0245, lr_0 = 9.9587e-04
Loss = 5.7671e-02, PNorm = 711.6962, GNorm = 1.9669, lr_0 = 9.9586e-04
Validation auc = 0.688012
Epoch 6080
Loss = 5.9609e-02, PNorm = 711.7415, GNorm = 0.2492, lr_0 = 9.9586e-04
Validation auc = 0.690951
Epoch 6081
Loss = 4.3556e-02, PNorm = 711.7765, GNorm = 2.2540, lr_0 = 9.9586e-04
Validation auc = 0.688481
Epoch 6082
Loss = 8.0418e-02, PNorm = 711.8184, GNorm = 1.7272, lr_0 = 9.9586e-04
Validation auc = 0.686341
Epoch 6083
Loss = 6.5803e-02, PNorm = 711.8700, GNorm = 2.0402, lr_0 = 9.9586e-04
Validation auc = 0.683503
Epoch 6084
Loss = 3.1388e-02, PNorm = 711.9264, GNorm = 0.4182, lr_0 = 9.9586e-04
Validation auc = 0.680770
Epoch 6085
Loss = 8.2500e-02, PNorm = 711.9701, GNorm = 5.4687, lr_0 = 9.9586e-04
Validation auc = 0.679724
Epoch 6086
Loss = 4.8050e-02, PNorm = 712.0156, GNorm = 2.2773, lr_0 = 9.9586e-04
Validation auc = 0.680070
Epoch 6087
Loss = 3.1234e-02, PNorm = 712.0618, GNorm = 1.3571, lr_0 = 9.9586e-04
Validation auc = 0.684025
Epoch 6088
Loss = 7.1467e-02, PNorm = 712.0986, GNorm = 12.0941, lr_0 = 9.9586e-04
Validation auc = 0.678984
Epoch 6089
Loss = 2.3479e-01, PNorm = 712.1462, GNorm = 16.1911, lr_0 = 9.9586e-04
Loss = 1.8885e-02, PNorm = 712.1950, GNorm = 0.1978, lr_0 = 9.9586e-04
Validation auc = 0.669749
Epoch 6090
Loss = 3.2184e-02, PNorm = 712.2321, GNorm = 7.8014, lr_0 = 9.9586e-04
Validation auc = 0.669962
Epoch 6091
Loss = 3.9564e-02, PNorm = 712.2728, GNorm = 2.5058, lr_0 = 9.9586e-04
Validation auc = 0.674389
Epoch 6092
Loss = 7.7751e-02, PNorm = 712.3175, GNorm = 7.8257, lr_0 = 9.9585e-04
Validation auc = 0.681801
Epoch 6093
Loss = 7.4227e-02, PNorm = 712.3739, GNorm = 3.3845, lr_0 = 9.9585e-04
Validation auc = 0.682252
Epoch 6094
Loss = 2.5250e-01, PNorm = 712.4326, GNorm = 0.8198, lr_0 = 9.9585e-04
Validation auc = 0.688700
Epoch 6095
Loss = 3.9745e-02, PNorm = 712.4903, GNorm = 3.1667, lr_0 = 9.9585e-04
Validation auc = 0.689797
Epoch 6096
Loss = 1.9375e-01, PNorm = 712.5351, GNorm = 7.9019, lr_0 = 9.9585e-04
Validation auc = 0.697217
Epoch 6097
Loss = 1.8314e-02, PNorm = 712.5977, GNorm = 1.7377, lr_0 = 9.9585e-04
Validation auc = 0.709248
Epoch 6098
Loss = 2.9040e-01, PNorm = 712.6580, GNorm = 1.1350, lr_0 = 9.9585e-04
Validation auc = 0.707987
Epoch 6099
Loss = 1.8117e-02, PNorm = 712.7108, GNorm = 1.2233, lr_0 = 9.9585e-04
Loss = 6.0231e-02, PNorm = 712.7524, GNorm = 1.2216, lr_0 = 9.9585e-04
Validation auc = 0.703565
Epoch 6100
Loss = 1.0562e+00, PNorm = 712.8620, GNorm = 4.6573, lr_0 = 9.9585e-04
Validation auc = 0.691300
Epoch 6101
Loss = 1.1562e-01, PNorm = 713.0396, GNorm = 4.0926, lr_0 = 9.9585e-04
Validation auc = 0.705647
Epoch 6102
Loss = 3.0886e-01, PNorm = 713.1711, GNorm = 4.3490, lr_0 = 9.9585e-04
Validation auc = 0.713971
Epoch 6103
Loss = 3.0491e-01, PNorm = 713.3031, GNorm = 2.8058, lr_0 = 9.9585e-04
Validation auc = 0.714817
Epoch 6104
Loss = 1.2723e-01, PNorm = 713.4163, GNorm = 3.5822, lr_0 = 9.9585e-04
Validation auc = 0.715314
Epoch 6105
Loss = 8.2809e-02, PNorm = 713.4975, GNorm = 2.8238, lr_0 = 9.9585e-04
Validation auc = 0.713694
Epoch 6106
Loss = 8.7308e-02, PNorm = 713.5582, GNorm = 5.2751, lr_0 = 9.9584e-04
Validation auc = 0.711666
Epoch 6107
Loss = 9.9889e-02, PNorm = 713.6130, GNorm = 6.7547, lr_0 = 9.9584e-04
Validation auc = 0.707209
Epoch 6108
Loss = 1.3078e-01, PNorm = 713.6732, GNorm = 6.1534, lr_0 = 9.9584e-04
Validation auc = 0.692695
Epoch 6109
Loss = 2.6210e-02, PNorm = 713.7453, GNorm = 0.8722, lr_0 = 9.9584e-04
Loss = 6.4999e-02, PNorm = 713.8161, GNorm = 6.4946, lr_0 = 9.9584e-04
Validation auc = 0.669649
Epoch 6110
Loss = 8.0659e-02, PNorm = 713.8767, GNorm = 1.9145, lr_0 = 9.9584e-04
Validation auc = 0.655897
Epoch 6111
Loss = 6.8074e-02, PNorm = 713.9318, GNorm = 4.5654, lr_0 = 9.9584e-04
Validation auc = 0.656836
Epoch 6112
Loss = 6.8732e-02, PNorm = 713.9879, GNorm = 1.0000, lr_0 = 9.9584e-04
Validation auc = 0.660941
Epoch 6113
Loss = 8.5835e-02, PNorm = 714.0355, GNorm = 2.9639, lr_0 = 9.9584e-04
Validation auc = 0.666928
Epoch 6114
Loss = 6.3098e-02, PNorm = 714.0856, GNorm = 1.1030, lr_0 = 9.9584e-04
Validation auc = 0.676338
Epoch 6115
Loss = 1.4882e-01, PNorm = 714.1405, GNorm = 1.8553, lr_0 = 9.9584e-04
Validation auc = 0.678137
Epoch 6116
Loss = 7.4792e-02, PNorm = 714.2054, GNorm = 2.6744, lr_0 = 9.9584e-04
Validation auc = 0.678568
Epoch 6117
Loss = 6.4805e-02, PNorm = 714.2675, GNorm = 2.5537, lr_0 = 9.9584e-04
Validation auc = 0.679571
Epoch 6118
Loss = 8.0794e-02, PNorm = 714.3228, GNorm = 4.1132, lr_0 = 9.9584e-04
Validation auc = 0.680332
Epoch 6119
Loss = 1.2237e-01, PNorm = 714.3762, GNorm = 3.6061, lr_0 = 9.9583e-04
Loss = 1.3662e-01, PNorm = 714.4387, GNorm = 1.4783, lr_0 = 9.9583e-04
Validation auc = 0.675537
Epoch 6120
Loss = 5.3354e-02, PNorm = 714.5100, GNorm = 1.3166, lr_0 = 9.9583e-04
Validation auc = 0.674821
Epoch 6121
Loss = 8.0846e-02, PNorm = 714.5644, GNorm = 2.7086, lr_0 = 9.9583e-04
Validation auc = 0.668057
Epoch 6122
Loss = 5.0341e-02, PNorm = 714.6076, GNorm = 2.2353, lr_0 = 9.9583e-04
Validation auc = 0.666428
Epoch 6123
Loss = 9.7918e-02, PNorm = 714.6553, GNorm = 2.7352, lr_0 = 9.9583e-04
Validation auc = 0.676785
Epoch 6124
Loss = 5.2766e-02, PNorm = 714.7131, GNorm = 0.6394, lr_0 = 9.9583e-04
Validation auc = 0.685351
Epoch 6125
Loss = 1.2733e-01, PNorm = 714.7673, GNorm = 3.1360, lr_0 = 9.9583e-04
Validation auc = 0.685785
Epoch 6126
Loss = 2.7671e-02, PNorm = 714.8269, GNorm = 0.8168, lr_0 = 9.9583e-04
Validation auc = 0.684027
Epoch 6127
Loss = 5.7238e-02, PNorm = 714.8769, GNorm = 1.9071, lr_0 = 9.9583e-04
Validation auc = 0.690586
Epoch 6128
Loss = 4.7123e-02, PNorm = 714.9212, GNorm = 2.6837, lr_0 = 9.9583e-04
Validation auc = 0.697764
Epoch 6129
Loss = 1.5647e-02, PNorm = 714.9558, GNorm = 0.9684, lr_0 = 9.9583e-04
Loss = 8.8530e-02, PNorm = 714.9964, GNorm = 0.5333, lr_0 = 9.9583e-04
Validation auc = 0.699044
Epoch 6130
Loss = 4.0447e-02, PNorm = 715.0398, GNorm = 1.2484, lr_0 = 9.9583e-04
Validation auc = 0.697437
Epoch 6131
Loss = 5.1090e-02, PNorm = 715.0790, GNorm = 1.4282, lr_0 = 9.9583e-04
Validation auc = 0.695531
Epoch 6132
Loss = 5.3186e-02, PNorm = 715.1178, GNorm = 0.4603, lr_0 = 9.9582e-04
Validation auc = 0.698873
Epoch 6133
Loss = 7.3415e-02, PNorm = 715.1548, GNorm = 0.4896, lr_0 = 9.9582e-04
Validation auc = 0.699125
Epoch 6134
Loss = 2.7440e-02, PNorm = 715.1976, GNorm = 1.9153, lr_0 = 9.9582e-04
Validation auc = 0.695208
Epoch 6135
Loss = 4.7084e-02, PNorm = 715.2340, GNorm = 0.6548, lr_0 = 9.9582e-04
Validation auc = 0.693403
Epoch 6136
Loss = 1.4827e-01, PNorm = 715.2721, GNorm = 2.5649, lr_0 = 9.9582e-04
Validation auc = 0.692365
Epoch 6137
Loss = 4.5470e-02, PNorm = 715.3241, GNorm = 0.9629, lr_0 = 9.9582e-04
Validation auc = 0.691724
Epoch 6138
Loss = 6.2651e-02, PNorm = 715.3633, GNorm = 3.0542, lr_0 = 9.9582e-04
Validation auc = 0.692771
Epoch 6139
Loss = 4.3424e-02, PNorm = 715.4037, GNorm = 2.8362, lr_0 = 9.9582e-04
Loss = 1.4516e-01, PNorm = 715.4486, GNorm = 1.4476, lr_0 = 9.9582e-04
Validation auc = 0.699549
Epoch 6140
Loss = 9.3713e-02, PNorm = 715.5049, GNorm = 0.6264, lr_0 = 9.9582e-04
Validation auc = 0.698004
Epoch 6141
Loss = 4.6919e-02, PNorm = 715.5652, GNorm = 1.3048, lr_0 = 9.9582e-04
Validation auc = 0.691215
Epoch 6142
Loss = 8.2207e-02, PNorm = 715.6117, GNorm = 0.9226, lr_0 = 9.9582e-04
Validation auc = 0.689995
Epoch 6143
Loss = 3.4347e-02, PNorm = 715.6484, GNorm = 0.5908, lr_0 = 9.9582e-04
Validation auc = 0.692166
Epoch 6144
Loss = 5.6209e-02, PNorm = 715.6778, GNorm = 3.1024, lr_0 = 9.9582e-04
Validation auc = 0.690561
Epoch 6145
Loss = 1.1149e-01, PNorm = 715.7104, GNorm = 2.8384, lr_0 = 9.9582e-04
Validation auc = 0.691444
Epoch 6146
Loss = 1.0427e-01, PNorm = 715.7585, GNorm = 6.0457, lr_0 = 9.9581e-04
Validation auc = 0.687265
Epoch 6147
Loss = 2.7548e-02, PNorm = 715.8044, GNorm = 1.6064, lr_0 = 9.9581e-04
Validation auc = 0.687390
Epoch 6148
Loss = 4.2033e-02, PNorm = 715.8366, GNorm = 2.9717, lr_0 = 9.9581e-04
Validation auc = 0.689486
Epoch 6149
Loss = 4.7650e-02, PNorm = 715.8714, GNorm = 2.0206, lr_0 = 9.9581e-04
Loss = 6.0849e-02, PNorm = 715.8995, GNorm = 0.7795, lr_0 = 9.9581e-04
Validation auc = 0.688087
Epoch 6150
Loss = 7.4391e-02, PNorm = 715.9324, GNorm = 4.8094, lr_0 = 9.9581e-04
Validation auc = 0.687083
Epoch 6151
Loss = 7.4068e-02, PNorm = 715.9630, GNorm = 0.3441, lr_0 = 9.9581e-04
Validation auc = 0.685429
Epoch 6152
Loss = 5.0489e-02, PNorm = 715.9946, GNorm = 0.5370, lr_0 = 9.9581e-04
Validation auc = 0.686251
Epoch 6153
Loss = 4.9304e-02, PNorm = 716.0224, GNorm = 1.4863, lr_0 = 9.9581e-04
Validation auc = 0.682808
Epoch 6154
Loss = 5.9034e-02, PNorm = 716.0495, GNorm = 4.2706, lr_0 = 9.9581e-04
Validation auc = 0.684285
Epoch 6155
Loss = 1.1566e-01, PNorm = 716.0808, GNorm = 9.1502, lr_0 = 9.9581e-04
Validation auc = 0.689283
Epoch 6156
Loss = 7.5681e-02, PNorm = 716.1203, GNorm = 0.4619, lr_0 = 9.9581e-04
Validation auc = 0.695720
Epoch 6157
Loss = 4.1243e-02, PNorm = 716.1554, GNorm = 0.9507, lr_0 = 9.9581e-04
Validation auc = 0.699667
Epoch 6158
Loss = 1.8515e-02, PNorm = 716.1808, GNorm = 0.5244, lr_0 = 9.9581e-04
Validation auc = 0.704938
Epoch 6159
Loss = 4.8352e-03, PNorm = 716.2033, GNorm = 0.3613, lr_0 = 9.9580e-04
Loss = 4.2202e-02, PNorm = 716.2311, GNorm = 0.4127, lr_0 = 9.9580e-04
Validation auc = 0.710202
Epoch 6160
Loss = 4.9088e-02, PNorm = 716.2611, GNorm = 1.8539, lr_0 = 9.9580e-04
Validation auc = 0.713426
Epoch 6161
Loss = 9.9993e-02, PNorm = 716.3015, GNorm = 6.1725, lr_0 = 9.9580e-04
Validation auc = 0.692858
Epoch 6162
Loss = 8.8883e-02, PNorm = 716.3456, GNorm = 0.5916, lr_0 = 9.9580e-04
Validation auc = 0.681784
Epoch 6163
Loss = 9.1452e-02, PNorm = 716.3881, GNorm = 0.2107, lr_0 = 9.9580e-04
Validation auc = 0.682064
Epoch 6164
Loss = 3.7495e-02, PNorm = 716.4318, GNorm = 0.7309, lr_0 = 9.9580e-04
Validation auc = 0.685063
Epoch 6165
Loss = 3.8822e-02, PNorm = 716.4811, GNorm = 0.5774, lr_0 = 9.9580e-04
Validation auc = 0.687684
Epoch 6166
Loss = 2.6555e-02, PNorm = 716.5297, GNorm = 3.8126, lr_0 = 9.9580e-04
Validation auc = 0.692885
Epoch 6167
Loss = 6.8220e-02, PNorm = 716.5681, GNorm = 3.5071, lr_0 = 9.9580e-04
Validation auc = 0.699077
Epoch 6168
Loss = 3.9542e-02, PNorm = 716.6043, GNorm = 1.3899, lr_0 = 9.9580e-04
Validation auc = 0.706171
Epoch 6169
Loss = 8.7037e-03, PNorm = 716.6407, GNorm = 0.5180, lr_0 = 9.9580e-04
Loss = 5.9586e-02, PNorm = 716.6734, GNorm = 0.8758, lr_0 = 9.9580e-04
Validation auc = 0.707832
Epoch 6170
Loss = 5.1499e-02, PNorm = 716.7006, GNorm = 4.0257, lr_0 = 9.9580e-04
Validation auc = 0.706789
Epoch 6171
Loss = 1.0333e-01, PNorm = 716.7388, GNorm = 2.7975, lr_0 = 9.9580e-04
Validation auc = 0.698492
Epoch 6172
Loss = 3.9852e-02, PNorm = 716.7801, GNorm = 0.5916, lr_0 = 9.9579e-04
Validation auc = 0.697263
Epoch 6173
Loss = 5.5107e-02, PNorm = 716.8157, GNorm = 3.5688, lr_0 = 9.9579e-04
Validation auc = 0.697764
Epoch 6174
Loss = 3.2875e-02, PNorm = 716.8485, GNorm = 3.2783, lr_0 = 9.9579e-04
Validation auc = 0.699690
Epoch 6175
Loss = 3.4520e-02, PNorm = 716.8789, GNorm = 0.5535, lr_0 = 9.9579e-04
Validation auc = 0.700829
Epoch 6176
Loss = 4.3426e-02, PNorm = 716.9128, GNorm = 3.6652, lr_0 = 9.9579e-04
Validation auc = 0.701755
Epoch 6177
Loss = 2.6885e-02, PNorm = 716.9438, GNorm = 0.6702, lr_0 = 9.9579e-04
Validation auc = 0.702242
Epoch 6178
Loss = 6.0182e-02, PNorm = 716.9696, GNorm = 2.1372, lr_0 = 9.9579e-04
Validation auc = 0.702817
Epoch 6179
Loss = 1.0109e-01, PNorm = 716.9937, GNorm = 2.5393, lr_0 = 9.9579e-04
Loss = 8.3796e-02, PNorm = 717.0254, GNorm = 0.6038, lr_0 = 9.9579e-04
Validation auc = 0.701928
Epoch 6180
Loss = 3.4497e-02, PNorm = 717.0664, GNorm = 2.8634, lr_0 = 9.9579e-04
Validation auc = 0.700446
Epoch 6181
Loss = 3.5812e-02, PNorm = 717.1033, GNorm = 5.0524, lr_0 = 9.9579e-04
Validation auc = 0.699682
Epoch 6182
Loss = 4.5896e-02, PNorm = 717.1358, GNorm = 2.1237, lr_0 = 9.9579e-04
Validation auc = 0.703137
Epoch 6183
Loss = 3.8513e-02, PNorm = 717.1644, GNorm = 1.1742, lr_0 = 9.9579e-04
Validation auc = 0.703596
Epoch 6184
Loss = 5.8065e-02, PNorm = 717.1922, GNorm = 0.9613, lr_0 = 9.9579e-04
Validation auc = 0.709569
Epoch 6185
Loss = 4.3931e-02, PNorm = 717.2243, GNorm = 1.2249, lr_0 = 9.9578e-04
Validation auc = 0.710942
Epoch 6186
Loss = 6.0468e-02, PNorm = 717.2617, GNorm = 0.8019, lr_0 = 9.9578e-04
Validation auc = 0.712827
Epoch 6187
Loss = 1.1287e-02, PNorm = 717.2985, GNorm = 1.1964, lr_0 = 9.9578e-04
Validation auc = 0.714363
Epoch 6188
Loss = 2.1711e-02, PNorm = 717.3244, GNorm = 0.2927, lr_0 = 9.9578e-04
Validation auc = 0.717935
Epoch 6189
Loss = 1.5952e-02, PNorm = 717.3437, GNorm = 1.5925, lr_0 = 9.9578e-04
Loss = 5.7275e-02, PNorm = 717.3640, GNorm = 3.6093, lr_0 = 9.9578e-04
Validation auc = 0.719194
Epoch 6190
Loss = 2.3014e-02, PNorm = 717.3942, GNorm = 0.4647, lr_0 = 9.9578e-04
Validation auc = 0.717432
Epoch 6191
Loss = 5.0509e-02, PNorm = 717.4234, GNorm = 0.1679, lr_0 = 9.9578e-04
Validation auc = 0.714951
Epoch 6192
Loss = 8.4756e-02, PNorm = 717.4526, GNorm = 1.4460, lr_0 = 9.9578e-04
Validation auc = 0.712111
Epoch 6193
Loss = 3.6908e-02, PNorm = 717.4872, GNorm = 2.0628, lr_0 = 9.9578e-04
Validation auc = 0.710857
Epoch 6194
Loss = 9.7288e-02, PNorm = 717.5296, GNorm = 3.4150, lr_0 = 9.9578e-04
Validation auc = 0.698163
Epoch 6195
Loss = 6.2869e-02, PNorm = 717.5751, GNorm = 1.4393, lr_0 = 9.9578e-04
Validation auc = 0.693498
Epoch 6196
Loss = 7.2663e-02, PNorm = 717.6084, GNorm = 4.7405, lr_0 = 9.9578e-04
Validation auc = 0.699539
Epoch 6197
Loss = 6.1320e-02, PNorm = 717.6379, GNorm = 3.2669, lr_0 = 9.9578e-04
Validation auc = 0.703056
Epoch 6198
Loss = 5.9747e-02, PNorm = 717.6622, GNorm = 1.9138, lr_0 = 9.9578e-04
Validation auc = 0.703522
Epoch 6199
Loss = 2.8385e-01, PNorm = 717.6874, GNorm = 5.7523, lr_0 = 9.9577e-04
Loss = 5.9240e-02, PNorm = 717.7135, GNorm = 8.7692, lr_0 = 9.9577e-04
Validation auc = 0.707635
Epoch 6200
Loss = 2.5696e-02, PNorm = 717.7472, GNorm = 1.6244, lr_0 = 9.9577e-04
Validation auc = 0.709690
Epoch 6201
Loss = 5.4220e-02, PNorm = 717.7784, GNorm = 1.7329, lr_0 = 9.9577e-04
Validation auc = 0.704441
Epoch 6202
Loss = 3.1118e-02, PNorm = 717.8131, GNorm = 0.3869, lr_0 = 9.9577e-04
Validation auc = 0.700990
Epoch 6203
Loss = 3.4684e-02, PNorm = 717.8432, GNorm = 4.3526, lr_0 = 9.9577e-04
Validation auc = 0.705540
Epoch 6204
Loss = 9.0158e-02, PNorm = 717.8788, GNorm = 12.7892, lr_0 = 9.9577e-04
Validation auc = 0.705589
Epoch 6205
Loss = 7.1245e-02, PNorm = 717.9249, GNorm = 1.1391, lr_0 = 9.9577e-04
Validation auc = 0.701203
Epoch 6206
Loss = 3.5859e-02, PNorm = 717.9636, GNorm = 1.7089, lr_0 = 9.9577e-04
Validation auc = 0.700785
Epoch 6207
Loss = 1.4728e-02, PNorm = 717.9982, GNorm = 1.7467, lr_0 = 9.9577e-04
Validation auc = 0.702007
Epoch 6208
Loss = 2.3162e-02, PNorm = 718.0273, GNorm = 1.9730, lr_0 = 9.9577e-04
Validation auc = 0.699655
Epoch 6209
Loss = 3.2726e-02, PNorm = 718.0579, GNorm = 1.2390, lr_0 = 9.9577e-04
Loss = 5.3959e-02, PNorm = 718.0858, GNorm = 1.4595, lr_0 = 9.9577e-04
Validation auc = 0.700355
Epoch 6210
Loss = 3.3874e-02, PNorm = 718.1197, GNorm = 0.3390, lr_0 = 9.9577e-04
Validation auc = 0.701975
Epoch 6211
Loss = 3.9284e-02, PNorm = 718.1608, GNorm = 0.6522, lr_0 = 9.9576e-04
Validation auc = 0.701418
Epoch 6212
Loss = 4.5709e-02, PNorm = 718.1953, GNorm = 0.5309, lr_0 = 9.9576e-04
Validation auc = 0.704348
Epoch 6213
Loss = 2.6605e-02, PNorm = 718.2243, GNorm = 0.4362, lr_0 = 9.9576e-04
Validation auc = 0.704520
Epoch 6214
Loss = 2.6494e-01, PNorm = 718.2495, GNorm = 1.7212, lr_0 = 9.9576e-04
Validation auc = 0.711567
Epoch 6215
Loss = 1.6156e-02, PNorm = 718.2844, GNorm = 1.6862, lr_0 = 9.9576e-04
Validation auc = 0.717116
Epoch 6216
Loss = 1.2075e-02, PNorm = 718.3105, GNorm = 0.4196, lr_0 = 9.9576e-04
Validation auc = 0.718871
Epoch 6217
Loss = 4.6342e-02, PNorm = 718.3275, GNorm = 3.2102, lr_0 = 9.9576e-04
Validation auc = 0.718380
Epoch 6218
Loss = 2.7828e-02, PNorm = 718.3565, GNorm = 2.8832, lr_0 = 9.9576e-04
Validation auc = 0.715019
Epoch 6219
Loss = 7.5759e-03, PNorm = 718.3869, GNorm = 0.4268, lr_0 = 9.9576e-04
Loss = 2.6835e-02, PNorm = 718.4107, GNorm = 0.4403, lr_0 = 9.9576e-04
Validation auc = 0.715708
Epoch 6220
Loss = 3.8396e-02, PNorm = 718.4339, GNorm = 2.5508, lr_0 = 9.9576e-04
Validation auc = 0.716470
Epoch 6221
Loss = 1.7950e-02, PNorm = 718.4589, GNorm = 0.5777, lr_0 = 9.9576e-04
Validation auc = 0.712154
Epoch 6222
Loss = 7.0688e-02, PNorm = 718.4917, GNorm = 1.5002, lr_0 = 9.9576e-04
Validation auc = 0.697754
Epoch 6223
Loss = 5.4459e-02, PNorm = 718.5356, GNorm = 0.4672, lr_0 = 9.9576e-04
Validation auc = 0.697126
Epoch 6224
Loss = 2.4611e-02, PNorm = 718.5733, GNorm = 1.4750, lr_0 = 9.9576e-04
Validation auc = 0.696982
Epoch 6225
Loss = 5.3035e-02, PNorm = 718.6005, GNorm = 0.7365, lr_0 = 9.9575e-04
Validation auc = 0.698670
Epoch 6226
Loss = 5.1659e-02, PNorm = 718.6411, GNorm = 0.6275, lr_0 = 9.9575e-04
Validation auc = 0.699004
Epoch 6227
Loss = 3.8695e-02, PNorm = 718.6905, GNorm = 2.7522, lr_0 = 9.9575e-04
Validation auc = 0.698182
Epoch 6228
Loss = 7.9461e-02, PNorm = 718.7359, GNorm = 1.5971, lr_0 = 9.9575e-04
Validation auc = 0.697387
Epoch 6229
Loss = 1.9215e-02, PNorm = 718.7768, GNorm = 1.3311, lr_0 = 9.9575e-04
Loss = 4.2066e-02, PNorm = 718.8130, GNorm = 1.3847, lr_0 = 9.9575e-04
Validation auc = 0.698607
Epoch 6230
Loss = 8.4405e-02, PNorm = 718.8470, GNorm = 0.1170, lr_0 = 9.9575e-04
Validation auc = 0.703135
Epoch 6231
Loss = 4.2603e-02, PNorm = 718.8851, GNorm = 0.8991, lr_0 = 9.9575e-04
Validation auc = 0.706459
Epoch 6232
Loss = 5.0427e-02, PNorm = 718.9229, GNorm = 3.6754, lr_0 = 9.9575e-04
Validation auc = 0.704458
Epoch 6233
Loss = 3.2154e-02, PNorm = 718.9623, GNorm = 3.5554, lr_0 = 9.9575e-04
Validation auc = 0.704583
Epoch 6234
Loss = 4.3217e-02, PNorm = 719.0064, GNorm = 0.7319, lr_0 = 9.9575e-04
Validation auc = 0.702105
Epoch 6235
Loss = 5.4871e-02, PNorm = 719.0537, GNorm = 1.3610, lr_0 = 9.9575e-04
Validation auc = 0.704846
Epoch 6236
Loss = 2.8978e-02, PNorm = 719.0940, GNorm = 2.5693, lr_0 = 9.9575e-04
Validation auc = 0.703263
Epoch 6237
Loss = 6.0964e-02, PNorm = 719.1310, GNorm = 3.6179, lr_0 = 9.9575e-04
Validation auc = 0.703671
Epoch 6238
Loss = 6.6969e-02, PNorm = 719.1670, GNorm = 3.4955, lr_0 = 9.9575e-04
Validation auc = 0.706023
Epoch 6239
Loss = 6.8420e-02, PNorm = 719.1950, GNorm = 4.4772, lr_0 = 9.9574e-04
Loss = 5.1715e-02, PNorm = 719.2217, GNorm = 2.0010, lr_0 = 9.9574e-04
Validation auc = 0.705208
Epoch 6240
Loss = 8.7935e-02, PNorm = 719.2593, GNorm = 0.8829, lr_0 = 9.9574e-04
Validation auc = 0.699838
Epoch 6241
Loss = 8.9222e-02, PNorm = 719.3054, GNorm = 1.8860, lr_0 = 9.9574e-04
Validation auc = 0.694188
Epoch 6242
Loss = 1.8403e-02, PNorm = 719.3499, GNorm = 0.9344, lr_0 = 9.9574e-04
Validation auc = 0.693985
Epoch 6243
Loss = 7.1706e-02, PNorm = 719.3894, GNorm = 5.3672, lr_0 = 9.9574e-04
Validation auc = 0.690324
Epoch 6244
Loss = 2.4929e-01, PNorm = 719.4345, GNorm = 7.2273, lr_0 = 9.9574e-04
Validation auc = 0.688498
Epoch 6245
Loss = 4.8372e-02, PNorm = 719.4942, GNorm = 4.7370, lr_0 = 9.9574e-04
Validation auc = 0.686972
Epoch 6246
Loss = 1.9661e-02, PNorm = 719.5466, GNorm = 0.6177, lr_0 = 9.9574e-04
Validation auc = 0.686167
Epoch 6247
Loss = 8.8162e-02, PNorm = 719.5991, GNorm = 1.1420, lr_0 = 9.9574e-04
Validation auc = 0.701994
Epoch 6248
Loss = 8.7585e-02, PNorm = 719.6628, GNorm = 5.4694, lr_0 = 9.9574e-04
Validation auc = 0.704359
Epoch 6249
Loss = 5.5975e-02, PNorm = 719.7362, GNorm = 2.9160, lr_0 = 9.9574e-04
Loss = 1.0457e-01, PNorm = 719.7929, GNorm = 3.5493, lr_0 = 9.9574e-04
Validation auc = 0.707093
Epoch 6250
Loss = 4.4827e-02, PNorm = 719.8354, GNorm = 0.6730, lr_0 = 9.9574e-04
Validation auc = 0.701094
Epoch 6251
Loss = 8.8265e-02, PNorm = 719.8714, GNorm = 7.6898, lr_0 = 9.9573e-04
Validation auc = 0.696063
Epoch 6252
Loss = 5.2623e-02, PNorm = 719.9165, GNorm = 3.6998, lr_0 = 9.9573e-04
Validation auc = 0.695419
Epoch 6253
Loss = 4.0902e-02, PNorm = 719.9602, GNorm = 0.3825, lr_0 = 9.9573e-04
Validation auc = 0.697155
Epoch 6254
Loss = 9.0128e-02, PNorm = 719.9985, GNorm = 2.2839, lr_0 = 9.9573e-04
Validation auc = 0.698069
Epoch 6255
Loss = 7.0641e-02, PNorm = 720.0469, GNorm = 0.9610, lr_0 = 9.9573e-04
Validation auc = 0.697784
Epoch 6256
Loss = 3.7621e-02, PNorm = 720.0942, GNorm = 0.8266, lr_0 = 9.9573e-04
Validation auc = 0.697936
Epoch 6257
Loss = 2.4863e-02, PNorm = 720.1326, GNorm = 1.0458, lr_0 = 9.9573e-04
Validation auc = 0.696097
Epoch 6258
Loss = 2.3029e-02, PNorm = 720.1697, GNorm = 1.9185, lr_0 = 9.9573e-04
Validation auc = 0.696013
Epoch 6259
Loss = 2.4664e-02, PNorm = 720.2042, GNorm = 1.2414, lr_0 = 9.9573e-04
Loss = 6.7337e-02, PNorm = 720.2411, GNorm = 0.3533, lr_0 = 9.9573e-04
Validation auc = 0.687285
Epoch 6260
Loss = 4.1017e-02, PNorm = 720.2794, GNorm = 1.1952, lr_0 = 9.9573e-04
Validation auc = 0.688293
Epoch 6261
Loss = 5.2810e-02, PNorm = 720.3233, GNorm = 0.7630, lr_0 = 9.9573e-04
Validation auc = 0.692787
Epoch 6262
Loss = 4.7277e-02, PNorm = 720.3677, GNorm = 0.3633, lr_0 = 9.9573e-04
Validation auc = 0.696559
Epoch 6263
Loss = 5.2858e-02, PNorm = 720.4257, GNorm = 1.3249, lr_0 = 9.9573e-04
Validation auc = 0.689535
Epoch 6264
Loss = 2.2005e-02, PNorm = 720.4694, GNorm = 0.7662, lr_0 = 9.9573e-04
Validation auc = 0.685707
Epoch 6265
Loss = 3.6186e-02, PNorm = 720.5027, GNorm = 0.3112, lr_0 = 9.9572e-04
Validation auc = 0.678229
Epoch 6266
Loss = 5.1295e-02, PNorm = 720.5328, GNorm = 2.5641, lr_0 = 9.9572e-04
Validation auc = 0.669885
Epoch 6267
Loss = 1.8288e-02, PNorm = 720.5682, GNorm = 0.1690, lr_0 = 9.9572e-04
Validation auc = 0.671316
Epoch 6268
Loss = 1.1688e-01, PNorm = 720.5988, GNorm = 6.4923, lr_0 = 9.9572e-04
Validation auc = 0.681082
Epoch 6269
Loss = 2.5256e-02, PNorm = 720.6292, GNorm = 1.3107, lr_0 = 9.9572e-04
Loss = 4.3324e-02, PNorm = 720.6563, GNorm = 0.5743, lr_0 = 9.9572e-04
Validation auc = 0.689759
Epoch 6270
Loss = 1.1443e-02, PNorm = 720.6838, GNorm = 1.4015, lr_0 = 9.9572e-04
Validation auc = 0.694926
Epoch 6271
Loss = 1.2793e-01, PNorm = 720.7086, GNorm = 28.9720, lr_0 = 9.9572e-04
Validation auc = 0.694263
Epoch 6272
Loss = 3.3505e-02, PNorm = 720.7527, GNorm = 2.9828, lr_0 = 9.9572e-04
Validation auc = 0.699647
Epoch 6273
Loss = 5.7939e-02, PNorm = 720.7971, GNorm = 0.4659, lr_0 = 9.9572e-04
Validation auc = 0.703625
Epoch 6274
Loss = 2.1905e-01, PNorm = 720.8505, GNorm = 6.2039, lr_0 = 9.9572e-04
Validation auc = 0.695518
Epoch 6275
Loss = 8.8352e-02, PNorm = 720.9300, GNorm = 1.9265, lr_0 = 9.9572e-04
Validation auc = 0.696864
Epoch 6276
Loss = 7.9204e-02, PNorm = 720.9952, GNorm = 2.5196, lr_0 = 9.9572e-04
Validation auc = 0.698322
Epoch 6277
Loss = 5.2388e-02, PNorm = 721.0515, GNorm = 1.3990, lr_0 = 9.9572e-04
Validation auc = 0.696666
Epoch 6278
Loss = 3.1806e-02, PNorm = 721.0999, GNorm = 2.7309, lr_0 = 9.9571e-04
Validation auc = 0.698018
Epoch 6279
Loss = 8.8172e-02, PNorm = 721.1380, GNorm = 4.3052, lr_0 = 9.9571e-04
Loss = 4.9081e-02, PNorm = 721.1737, GNorm = 2.0504, lr_0 = 9.9571e-04
Validation auc = 0.703457
Epoch 6280
Loss = 3.6084e-02, PNorm = 721.2121, GNorm = 1.7385, lr_0 = 9.9571e-04
Validation auc = 0.705564
Epoch 6281
Loss = 5.1905e-02, PNorm = 721.2461, GNorm = 1.8198, lr_0 = 9.9571e-04
Validation auc = 0.700972
Epoch 6282
Loss = 4.1379e-02, PNorm = 721.2820, GNorm = 3.6070, lr_0 = 9.9571e-04
Validation auc = 0.702228
Epoch 6283
Loss = 2.6447e-02, PNorm = 721.3174, GNorm = 0.5734, lr_0 = 9.9571e-04
Validation auc = 0.698479
Epoch 6284
Loss = 2.5311e-02, PNorm = 721.3528, GNorm = 1.4339, lr_0 = 9.9571e-04
Validation auc = 0.690477
Epoch 6285
Loss = 2.2814e-02, PNorm = 721.3881, GNorm = 1.1078, lr_0 = 9.9571e-04
Validation auc = 0.695755
Epoch 6286
Loss = 2.8700e-02, PNorm = 721.4181, GNorm = 3.7611, lr_0 = 9.9571e-04
Validation auc = 0.700932
Epoch 6287
Loss = 1.6201e-02, PNorm = 721.4542, GNorm = 0.9726, lr_0 = 9.9571e-04
Validation auc = 0.704263
Epoch 6288
Loss = 3.3925e-02, PNorm = 721.4847, GNorm = 2.9586, lr_0 = 9.9571e-04
Validation auc = 0.707413
Epoch 6289
Loss = 6.5107e-03, PNorm = 721.5247, GNorm = 0.5013, lr_0 = 9.9571e-04
Loss = 5.5438e-02, PNorm = 721.5732, GNorm = 3.3035, lr_0 = 9.9571e-04
Validation auc = 0.703866
Epoch 6290
Loss = 3.7437e-02, PNorm = 721.6161, GNorm = 0.4122, lr_0 = 9.9571e-04
Validation auc = 0.696171
Epoch 6291
Loss = 3.0051e-02, PNorm = 721.6519, GNorm = 0.4912, lr_0 = 9.9570e-04
Validation auc = 0.697901
Epoch 6292
Loss = 2.1911e-02, PNorm = 721.6879, GNorm = 0.4664, lr_0 = 9.9570e-04
Validation auc = 0.704142
Epoch 6293
Loss = 3.1507e-02, PNorm = 721.7229, GNorm = 2.1608, lr_0 = 9.9570e-04
Validation auc = 0.704568
Epoch 6294
Loss = 2.0744e-02, PNorm = 721.7626, GNorm = 1.4649, lr_0 = 9.9570e-04
Validation auc = 0.703367
Epoch 6295
Loss = 6.5248e-02, PNorm = 721.8085, GNorm = 2.1688, lr_0 = 9.9570e-04
Validation auc = 0.705485
Epoch 6296
Loss = 1.6433e-02, PNorm = 721.8536, GNorm = 0.9199, lr_0 = 9.9570e-04
Validation auc = 0.710629
Epoch 6297
Loss = 3.7666e-02, PNorm = 721.8852, GNorm = 0.4386, lr_0 = 9.9570e-04
Validation auc = 0.713989
Epoch 6298
Loss = 1.4798e-02, PNorm = 721.9149, GNorm = 1.8045, lr_0 = 9.9570e-04
Validation auc = 0.719263
Epoch 6299
Loss = 1.4269e-02, PNorm = 721.9424, GNorm = 0.8286, lr_0 = 9.9570e-04
Loss = 5.6584e-02, PNorm = 721.9734, GNorm = 0.8285, lr_0 = 9.9570e-04
Validation auc = 0.715794
Epoch 6300
Loss = 2.4418e-02, PNorm = 722.0021, GNorm = 0.6196, lr_0 = 9.9570e-04
Validation auc = 0.713137
Epoch 6301
Loss = 3.3630e-02, PNorm = 722.0359, GNorm = 4.2870, lr_0 = 9.9570e-04
Validation auc = 0.711537
Epoch 6302
Loss = 2.3427e-02, PNorm = 722.0745, GNorm = 0.4092, lr_0 = 9.9570e-04
Validation auc = 0.710383
Epoch 6303
Loss = 2.4997e-02, PNorm = 722.1029, GNorm = 1.7776, lr_0 = 9.9570e-04
Validation auc = 0.708781
Epoch 6304
Loss = 2.2774e-02, PNorm = 722.1305, GNorm = 0.7526, lr_0 = 9.9570e-04
Validation auc = 0.703814
Epoch 6305
Loss = 5.7211e-02, PNorm = 722.1591, GNorm = 4.9426, lr_0 = 9.9569e-04
Validation auc = 0.707317
Epoch 6306
Loss = 1.5915e-02, PNorm = 722.1955, GNorm = 0.2564, lr_0 = 9.9569e-04
Validation auc = 0.705376
Epoch 6307
Loss = 5.2704e-02, PNorm = 722.2296, GNorm = 0.6477, lr_0 = 9.9569e-04
Validation auc = 0.692650
Epoch 6308
Loss = 3.4558e-02, PNorm = 722.2756, GNorm = 1.4604, lr_0 = 9.9569e-04
Validation auc = 0.690562
Epoch 6309
Loss = 9.9822e-03, PNorm = 722.3204, GNorm = 0.6103, lr_0 = 9.9569e-04
Loss = 4.9576e-02, PNorm = 722.3565, GNorm = 0.4368, lr_0 = 9.9569e-04
Validation auc = 0.692561
Epoch 6310
Loss = 6.3531e-02, PNorm = 722.4002, GNorm = 1.9379, lr_0 = 9.9569e-04
Validation auc = 0.692943
Epoch 6311
Loss = 2.6338e-02, PNorm = 722.4606, GNorm = 0.4266, lr_0 = 9.9569e-04
Validation auc = 0.695769
Epoch 6312
Loss = 1.5023e-02, PNorm = 722.5066, GNorm = 0.5699, lr_0 = 9.9569e-04
Validation auc = 0.698070
Epoch 6313
Loss = 3.6463e-02, PNorm = 722.5399, GNorm = 2.8620, lr_0 = 9.9569e-04
Validation auc = 0.694918
Epoch 6314
Loss = 3.9633e-02, PNorm = 722.5766, GNorm = 4.0180, lr_0 = 9.9569e-04
Validation auc = 0.706519
Epoch 6315
Loss = 5.5365e-02, PNorm = 722.6218, GNorm = 0.2432, lr_0 = 9.9569e-04
Validation auc = 0.707668
Epoch 6316
Loss = 3.8943e-02, PNorm = 722.6620, GNorm = 2.0600, lr_0 = 9.9569e-04
Validation auc = 0.703051
Epoch 6317
Loss = 1.5766e-02, PNorm = 722.7011, GNorm = 1.4181, lr_0 = 9.9569e-04
Validation auc = 0.702326
Epoch 6318
Loss = 3.0641e-01, PNorm = 722.7292, GNorm = 0.2780, lr_0 = 9.9568e-04
Validation auc = 0.706912
Epoch 6319
Loss = 2.5692e-01, PNorm = 722.7607, GNorm = 8.5681, lr_0 = 9.9568e-04
Loss = 1.0576e-01, PNorm = 722.8258, GNorm = 0.7242, lr_0 = 9.9568e-04
Validation auc = 0.702502
Epoch 6320
Loss = 4.0435e-02, PNorm = 722.8851, GNorm = 2.6978, lr_0 = 9.9568e-04
Validation auc = 0.698900
Epoch 6321
Loss = 4.8158e-02, PNorm = 722.9261, GNorm = 2.9517, lr_0 = 9.9568e-04
Validation auc = 0.691535
Epoch 6322
Loss = 5.5327e-02, PNorm = 722.9606, GNorm = 2.5259, lr_0 = 9.9568e-04
Validation auc = 0.692983
Epoch 6323
Loss = 2.3432e-02, PNorm = 722.9895, GNorm = 0.3246, lr_0 = 9.9568e-04
Validation auc = 0.697761
Epoch 6324
Loss = 8.2550e-03, PNorm = 723.0118, GNorm = 0.4263, lr_0 = 9.9568e-04
Validation auc = 0.699739
Epoch 6325
Loss = 4.0062e-02, PNorm = 723.0336, GNorm = 5.3751, lr_0 = 9.9568e-04
Validation auc = 0.708844
Epoch 6326
Loss = 1.1786e-02, PNorm = 723.0671, GNorm = 0.1081, lr_0 = 9.9568e-04
Validation auc = 0.713456
Epoch 6327
Loss = 1.2287e-02, PNorm = 723.0997, GNorm = 0.9184, lr_0 = 9.9568e-04
Validation auc = 0.715831
Epoch 6328
Loss = 3.0457e-02, PNorm = 723.1338, GNorm = 1.9435, lr_0 = 9.9568e-04
Validation auc = 0.717588
Epoch 6329
Loss = 4.3445e-02, PNorm = 723.1699, GNorm = 1.3202, lr_0 = 9.9568e-04
Loss = 3.4150e-02, PNorm = 723.2006, GNorm = 1.0807, lr_0 = 9.9568e-04
Validation auc = 0.719122
Epoch 6330
Loss = 1.9407e-02, PNorm = 723.2224, GNorm = 0.7561, lr_0 = 9.9568e-04
Validation auc = 0.717968
Epoch 6331
Loss = 4.9980e-02, PNorm = 723.2454, GNorm = 0.7523, lr_0 = 9.9567e-04
Validation auc = 0.717928
Epoch 6332
Loss = 1.4953e-01, PNorm = 723.2861, GNorm = 1.8010, lr_0 = 9.9567e-04
Validation auc = 0.721370
Epoch 6333
Loss = 4.4198e-02, PNorm = 723.3317, GNorm = 0.9650, lr_0 = 9.9567e-04
Validation auc = 0.717959
Epoch 6334
Loss = 5.7859e-02, PNorm = 723.3653, GNorm = 1.0126, lr_0 = 9.9567e-04
Validation auc = 0.710048
Epoch 6335
Loss = 5.2946e-02, PNorm = 723.4133, GNorm = 0.2151, lr_0 = 9.9567e-04
Validation auc = 0.707503
Epoch 6336
Loss = 9.6524e-03, PNorm = 723.4587, GNorm = 0.3237, lr_0 = 9.9567e-04
Validation auc = 0.706069
Epoch 6337
Loss = 2.9147e-02, PNorm = 723.4974, GNorm = 1.4949, lr_0 = 9.9567e-04
Validation auc = 0.705800
Epoch 6338
Loss = 3.7630e-02, PNorm = 723.5494, GNorm = 3.7543, lr_0 = 9.9567e-04
Validation auc = 0.701764
Epoch 6339
Loss = 1.1264e-02, PNorm = 723.5975, GNorm = 0.5107, lr_0 = 9.9567e-04
Loss = 2.4719e-02, PNorm = 723.6331, GNorm = 1.9465, lr_0 = 9.9567e-04
Validation auc = 0.699563
Epoch 6340
Loss = 7.5767e-02, PNorm = 723.6728, GNorm = 0.8184, lr_0 = 9.9567e-04
Validation auc = 0.692999
Epoch 6341
Loss = 3.2831e-02, PNorm = 723.7154, GNorm = 0.8009, lr_0 = 9.9567e-04
Validation auc = 0.693199
Epoch 6342
Loss = 3.5144e-02, PNorm = 723.7451, GNorm = 1.2369, lr_0 = 9.9567e-04
Validation auc = 0.694863
Epoch 6343
Loss = 9.1168e-02, PNorm = 723.7803, GNorm = 6.2743, lr_0 = 9.9567e-04
Validation auc = 0.694005
Epoch 6344
Loss = 4.1085e-02, PNorm = 723.8248, GNorm = 0.8812, lr_0 = 9.9566e-04
Validation auc = 0.698414
Epoch 6345
Loss = 1.4581e-02, PNorm = 723.8733, GNorm = 0.5855, lr_0 = 9.9566e-04
Validation auc = 0.694996
Epoch 6346
Loss = 1.2124e-02, PNorm = 723.9162, GNorm = 4.6921, lr_0 = 9.9566e-04
Validation auc = 0.693198
Epoch 6347
Loss = 3.5102e-02, PNorm = 723.9522, GNorm = 0.6186, lr_0 = 9.9566e-04
Validation auc = 0.696751
Epoch 6348
Loss = 7.7195e-02, PNorm = 723.9831, GNorm = 0.3107, lr_0 = 9.9566e-04
Validation auc = 0.694160
Epoch 6349
Loss = 1.0689e-02, PNorm = 724.0117, GNorm = 0.2100, lr_0 = 9.9566e-04
Loss = 2.2294e-02, PNorm = 724.0388, GNorm = 0.5137, lr_0 = 9.9566e-04
Validation auc = 0.687084
Epoch 6350
Loss = 4.1765e-02, PNorm = 724.0662, GNorm = 1.2540, lr_0 = 9.9566e-04
Validation auc = 0.679676
Epoch 6351
Loss = 5.0751e-02, PNorm = 724.0939, GNorm = 2.8939, lr_0 = 9.9566e-04
Validation auc = 0.669765
Epoch 6352
Loss = 3.5720e-02, PNorm = 724.1208, GNorm = 5.7065, lr_0 = 9.9566e-04
Validation auc = 0.661417
Epoch 6353
Loss = 4.9831e-02, PNorm = 724.1649, GNorm = 6.3324, lr_0 = 9.9566e-04
Validation auc = 0.665810
Epoch 6354
Loss = 1.6697e-02, PNorm = 724.2078, GNorm = 0.6767, lr_0 = 9.9566e-04
Validation auc = 0.671859
Epoch 6355
Loss = 4.3671e-02, PNorm = 724.2430, GNorm = 6.6686, lr_0 = 9.9566e-04
Validation auc = 0.667569
Epoch 6356
Loss = 2.5233e-02, PNorm = 724.2772, GNorm = 0.9554, lr_0 = 9.9566e-04
Validation auc = 0.673196
Epoch 6357
Loss = 1.2505e-01, PNorm = 724.3103, GNorm = 1.8417, lr_0 = 9.9566e-04
Validation auc = 0.673350
Epoch 6358
Loss = 1.1521e-02, PNorm = 724.3485, GNorm = 1.3435, lr_0 = 9.9565e-04
Validation auc = 0.669073
Epoch 6359
Loss = 2.3039e-02, PNorm = 724.4005, GNorm = 0.9686, lr_0 = 9.9565e-04
Loss = 3.8155e-02, PNorm = 724.4539, GNorm = 0.5208, lr_0 = 9.9565e-04
Validation auc = 0.675328
Epoch 6360
Loss = 2.1566e-02, PNorm = 724.4916, GNorm = 2.2638, lr_0 = 9.9565e-04
Validation auc = 0.678024
Epoch 6361
Loss = 6.1525e-02, PNorm = 724.5260, GNorm = 1.1605, lr_0 = 9.9565e-04
Validation auc = 0.670715
Epoch 6362
Loss = 6.3158e-02, PNorm = 724.5739, GNorm = 16.5001, lr_0 = 9.9565e-04
Validation auc = 0.656656
Epoch 6363
Loss = 2.3002e-02, PNorm = 724.6311, GNorm = 0.7962, lr_0 = 9.9565e-04
Validation auc = 0.669023
Epoch 6364
Loss = 3.9561e-02, PNorm = 724.6880, GNorm = 0.4209, lr_0 = 9.9565e-04
Validation auc = 0.706775
Epoch 6365
Loss = 6.9008e-02, PNorm = 724.7596, GNorm = 4.4882, lr_0 = 9.9565e-04
Validation auc = 0.708802
Epoch 6366
Loss = 3.7655e-02, PNorm = 724.8431, GNorm = 0.9229, lr_0 = 9.9565e-04
Validation auc = 0.697740
Epoch 6367
Loss = 7.0856e-02, PNorm = 724.9333, GNorm = 1.9090, lr_0 = 9.9565e-04
Validation auc = 0.691369
Epoch 6368
Loss = 8.2008e-02, PNorm = 725.0008, GNorm = 1.8051, lr_0 = 9.9565e-04
Validation auc = 0.685386
Epoch 6369
Loss = 4.2794e-02, PNorm = 725.0573, GNorm = 1.6490, lr_0 = 9.9565e-04
Loss = 4.9359e-02, PNorm = 725.1104, GNorm = 0.6145, lr_0 = 9.9565e-04
Validation auc = 0.686074
Epoch 6370
Loss = 9.6577e-02, PNorm = 725.1549, GNorm = 0.4186, lr_0 = 9.9565e-04
Validation auc = 0.690535
Epoch 6371
Loss = 5.3185e-02, PNorm = 725.1948, GNorm = 0.2608, lr_0 = 9.9564e-04
Validation auc = 0.699687
Epoch 6372
Loss = 2.9703e-02, PNorm = 725.2313, GNorm = 0.4370, lr_0 = 9.9564e-04
Validation auc = 0.702019
Epoch 6373
Loss = 6.3482e-02, PNorm = 725.2597, GNorm = 3.5554, lr_0 = 9.9564e-04
Validation auc = 0.703434
Epoch 6374
Loss = 6.9671e-02, PNorm = 725.2964, GNorm = 6.4755, lr_0 = 9.9564e-04
Validation auc = 0.706481
Epoch 6375
Loss = 4.6718e-02, PNorm = 725.3450, GNorm = 0.6659, lr_0 = 9.9564e-04
Validation auc = 0.706555
Epoch 6376
Loss = 7.4321e-02, PNorm = 725.3838, GNorm = 3.5050, lr_0 = 9.9564e-04
Validation auc = 0.704409
Epoch 6377
Loss = 4.7665e-02, PNorm = 725.4180, GNorm = 1.6008, lr_0 = 9.9564e-04
Validation auc = 0.705428
Epoch 6378
Loss = 3.6760e-02, PNorm = 725.4531, GNorm = 6.6515, lr_0 = 9.9564e-04
Validation auc = 0.705060
Epoch 6379
Loss = 1.4966e-01, PNorm = 725.4985, GNorm = 4.9454, lr_0 = 9.9564e-04
Loss = 3.7225e-02, PNorm = 725.5400, GNorm = 1.3121, lr_0 = 9.9564e-04
Validation auc = 0.703666
Epoch 6380
Loss = 3.0971e-02, PNorm = 725.5822, GNorm = 0.6105, lr_0 = 9.9564e-04
Validation auc = 0.695996
Epoch 6381
Loss = 3.1471e-02, PNorm = 725.6157, GNorm = 1.7387, lr_0 = 9.9564e-04
Validation auc = 0.685785
Epoch 6382
Loss = 3.1761e-02, PNorm = 725.6437, GNorm = 0.8324, lr_0 = 9.9564e-04
Validation auc = 0.683838
Epoch 6383
Loss = 1.7318e-02, PNorm = 725.6682, GNorm = 2.2332, lr_0 = 9.9564e-04
Validation auc = 0.683880
Epoch 6384
Loss = 8.7135e-02, PNorm = 725.6991, GNorm = 1.6195, lr_0 = 9.9563e-04
Validation auc = 0.688266
Epoch 6385
Loss = 2.6641e-02, PNorm = 725.7523, GNorm = 0.3255, lr_0 = 9.9563e-04
Validation auc = 0.686997
Epoch 6386
Loss = 6.0232e-02, PNorm = 725.8076, GNorm = 1.0701, lr_0 = 9.9563e-04
Validation auc = 0.687889
Epoch 6387
Loss = 4.3099e-02, PNorm = 725.8548, GNorm = 1.2911, lr_0 = 9.9563e-04
Validation auc = 0.688751
Epoch 6388
Loss = 4.1949e-02, PNorm = 725.9005, GNorm = 3.9744, lr_0 = 9.9563e-04
Validation auc = 0.690968
Epoch 6389
Loss = 8.4674e-02, PNorm = 725.9434, GNorm = 1.7397, lr_0 = 9.9563e-04
Loss = 2.3152e-02, PNorm = 725.9826, GNorm = 0.6870, lr_0 = 9.9563e-04
Validation auc = 0.689581
Epoch 6390
Loss = 4.0528e-02, PNorm = 726.0125, GNorm = 3.1463, lr_0 = 9.9563e-04
Validation auc = 0.688291
Epoch 6391
Loss = 5.9199e-02, PNorm = 726.0407, GNorm = 1.8392, lr_0 = 9.9563e-04
Validation auc = 0.691489
Epoch 6392
Loss = 5.3864e-02, PNorm = 726.0671, GNorm = 2.1764, lr_0 = 9.9563e-04
Validation auc = 0.691950
Epoch 6393
Loss = 2.1267e-02, PNorm = 726.0934, GNorm = 0.8387, lr_0 = 9.9563e-04
Validation auc = 0.688847
Epoch 6394
Loss = 4.6919e-02, PNorm = 726.1230, GNorm = 2.5189, lr_0 = 9.9563e-04
Validation auc = 0.683652
Epoch 6395
Loss = 1.3153e-01, PNorm = 726.1716, GNorm = 1.9418, lr_0 = 9.9563e-04
Validation auc = 0.701411
Epoch 6396
Loss = 4.6166e-02, PNorm = 726.2310, GNorm = 1.7535, lr_0 = 9.9563e-04
Validation auc = 0.712658
Epoch 6397
Loss = 2.6528e-02, PNorm = 726.2938, GNorm = 1.9504, lr_0 = 9.9563e-04
Validation auc = 0.711826
Epoch 6398
Loss = 7.3856e-03, PNorm = 726.3620, GNorm = 0.3910, lr_0 = 9.9562e-04
Validation auc = 0.705054
Epoch 6399
Loss = 1.1513e-02, PNorm = 726.4250, GNorm = 0.6184, lr_0 = 9.9562e-04
Loss = 5.5150e-02, PNorm = 726.4775, GNorm = 0.8667, lr_0 = 9.9562e-04
Validation auc = 0.694324
Epoch 6400
Loss = 4.3830e-02, PNorm = 726.5347, GNorm = 2.3478, lr_0 = 9.9562e-04
Validation auc = 0.678594
Epoch 6401
Loss = 4.3798e-02, PNorm = 726.5799, GNorm = 1.8252, lr_0 = 9.9562e-04
Validation auc = 0.673287
Epoch 6402
Loss = 2.5334e-02, PNorm = 726.6255, GNorm = 0.7016, lr_0 = 9.9562e-04
Validation auc = 0.674253
Epoch 6403
Loss = 1.6701e-02, PNorm = 726.6662, GNorm = 0.4350, lr_0 = 9.9562e-04
Validation auc = 0.675754
Epoch 6404
Loss = 1.0395e-02, PNorm = 726.7006, GNorm = 1.8903, lr_0 = 9.9562e-04
Validation auc = 0.674838
Epoch 6405
Loss = 6.2395e-02, PNorm = 726.7405, GNorm = 4.4729, lr_0 = 9.9562e-04
Validation auc = 0.674693
Epoch 6406
Loss = 1.0192e-01, PNorm = 726.8006, GNorm = 3.2307, lr_0 = 9.9562e-04
Validation auc = 0.673199
Epoch 6407
Loss = 2.8381e-02, PNorm = 726.8602, GNorm = 0.9508, lr_0 = 9.9562e-04
Validation auc = 0.671211
Epoch 6408
Loss = 4.8287e-02, PNorm = 726.9513, GNorm = 2.8572, lr_0 = 9.9562e-04
Validation auc = 0.664503
Epoch 6409
Loss = 1.7664e-01, PNorm = 727.0848, GNorm = 4.6426, lr_0 = 9.9562e-04
Loss = 1.3363e-01, PNorm = 727.1919, GNorm = 2.3961, lr_0 = 9.9562e-04
Validation auc = 0.670527
Epoch 6410
Loss = 1.2110e-01, PNorm = 727.2755, GNorm = 2.9897, lr_0 = 9.9561e-04
Validation auc = 0.678647
Epoch 6411
Loss = 8.1385e-02, PNorm = 727.3543, GNorm = 0.3450, lr_0 = 9.9561e-04
Validation auc = 0.683813
Epoch 6412
Loss = 9.8713e-02, PNorm = 727.4177, GNorm = 1.6620, lr_0 = 9.9561e-04
Validation auc = 0.688860
Epoch 6413
Loss = 6.1429e-02, PNorm = 727.4823, GNorm = 2.6656, lr_0 = 9.9561e-04
Validation auc = 0.687420
Epoch 6414
Loss = 9.4473e-02, PNorm = 727.5581, GNorm = 2.0618, lr_0 = 9.9561e-04
Validation auc = 0.698971
Epoch 6415
Loss = 8.6699e-02, PNorm = 727.6357, GNorm = 1.3225, lr_0 = 9.9561e-04
Validation auc = 0.692289
Epoch 6416
Loss = 6.5289e-02, PNorm = 727.7108, GNorm = 2.9446, lr_0 = 9.9561e-04
Validation auc = 0.690662
Epoch 6417
Loss = 7.8308e-02, PNorm = 727.7848, GNorm = 0.5502, lr_0 = 9.9561e-04
Validation auc = 0.697105
Epoch 6418
Loss = 8.4540e-02, PNorm = 727.8442, GNorm = 2.4434, lr_0 = 9.9561e-04
Validation auc = 0.703906
Epoch 6419
Loss = 7.6174e-02, PNorm = 727.8902, GNorm = 3.7162, lr_0 = 9.9561e-04
Loss = 5.7592e-02, PNorm = 727.9326, GNorm = 4.0373, lr_0 = 9.9561e-04
Validation auc = 0.697972
Epoch 6420
Loss = 7.2673e-02, PNorm = 727.9827, GNorm = 1.9316, lr_0 = 9.9561e-04
Validation auc = 0.690535
Epoch 6421
Loss = 2.7264e-02, PNorm = 728.0244, GNorm = 0.8497, lr_0 = 9.9561e-04
Validation auc = 0.689201
Epoch 6422
Loss = 1.2724e-01, PNorm = 728.0665, GNorm = 2.1945, lr_0 = 9.9561e-04
Validation auc = 0.688390
Epoch 6423
Loss = 3.6437e-02, PNorm = 728.1218, GNorm = 1.9498, lr_0 = 9.9561e-04
Validation auc = 0.690964
Epoch 6424
Loss = 1.2272e-01, PNorm = 728.1699, GNorm = 6.4689, lr_0 = 9.9560e-04
Validation auc = 0.688532
Epoch 6425
Loss = 3.4724e-02, PNorm = 728.2228, GNorm = 0.4228, lr_0 = 9.9560e-04
Validation auc = 0.685336
Epoch 6426
Loss = 4.7114e-02, PNorm = 728.2703, GNorm = 0.3226, lr_0 = 9.9560e-04
Validation auc = 0.685835
Epoch 6427
Loss = 1.4290e-02, PNorm = 728.3087, GNorm = 0.8317, lr_0 = 9.9560e-04
Validation auc = 0.685814
Epoch 6428
Loss = 8.2981e-02, PNorm = 728.3452, GNorm = 0.8735, lr_0 = 9.9560e-04
Validation auc = 0.689579
Epoch 6429
Loss = 1.2474e-01, PNorm = 728.3927, GNorm = 2.5941, lr_0 = 9.9560e-04
Loss = 8.1161e-02, PNorm = 728.4413, GNorm = 4.1725, lr_0 = 9.9560e-04
Validation auc = 0.701263
Epoch 6430
Loss = 1.0186e-01, PNorm = 728.4837, GNorm = 1.6045, lr_0 = 9.9560e-04
Validation auc = 0.697254
Epoch 6431
Loss = 8.0785e-02, PNorm = 728.5237, GNorm = 4.4860, lr_0 = 9.9560e-04
Validation auc = 0.695311
Epoch 6432
Loss = 4.9944e-02, PNorm = 728.5713, GNorm = 5.0538, lr_0 = 9.9560e-04
Validation auc = 0.693607
Epoch 6433
Loss = 7.2523e-02, PNorm = 728.6178, GNorm = 3.9638, lr_0 = 9.9560e-04
Validation auc = 0.693465
Epoch 6434
Loss = 1.1880e-01, PNorm = 728.6677, GNorm = 0.4766, lr_0 = 9.9560e-04
Validation auc = 0.696605
Epoch 6435
Loss = 8.6007e-02, PNorm = 728.7275, GNorm = 1.3046, lr_0 = 9.9560e-04
Validation auc = 0.700432
Epoch 6436
Loss = 5.0850e-02, PNorm = 728.7912, GNorm = 0.5473, lr_0 = 9.9560e-04
Validation auc = 0.696328
Epoch 6437
Loss = 5.4010e-02, PNorm = 728.8395, GNorm = 3.3510, lr_0 = 9.9559e-04
Validation auc = 0.690877
Epoch 6438
Loss = 1.1160e-01, PNorm = 728.8873, GNorm = 8.9305, lr_0 = 9.9559e-04
Validation auc = 0.692428
Epoch 6439
Loss = 4.9890e-02, PNorm = 728.9360, GNorm = 1.5343, lr_0 = 9.9559e-04
Loss = 4.7300e-02, PNorm = 728.9777, GNorm = 3.0077, lr_0 = 9.9559e-04
Validation auc = 0.693557
Epoch 6440
Loss = 5.8959e-02, PNorm = 729.0122, GNorm = 0.5040, lr_0 = 9.9559e-04
Validation auc = 0.694389
Epoch 6441
Loss = 5.1037e-02, PNorm = 729.0532, GNorm = 2.1510, lr_0 = 9.9559e-04
Validation auc = 0.695558
Epoch 6442
Loss = 2.4851e-02, PNorm = 729.0906, GNorm = 1.2492, lr_0 = 9.9559e-04
Validation auc = 0.693895
Epoch 6443
Loss = 2.6331e-02, PNorm = 729.1249, GNorm = 4.0632, lr_0 = 9.9559e-04
Validation auc = 0.695373
Epoch 6444
Loss = 3.0216e-02, PNorm = 729.1626, GNorm = 4.2493, lr_0 = 9.9559e-04
Validation auc = 0.697818
Epoch 6445
Loss = 1.1478e-02, PNorm = 729.1999, GNorm = 3.6130, lr_0 = 9.9559e-04
Validation auc = 0.698900
Epoch 6446
Loss = 4.1991e-02, PNorm = 729.2331, GNorm = 0.4340, lr_0 = 9.9559e-04
Validation auc = 0.698953
Epoch 6447
Loss = 8.2410e-03, PNorm = 729.2681, GNorm = 1.2356, lr_0 = 9.9559e-04
Validation auc = 0.701166
Epoch 6448
Loss = 1.3225e-02, PNorm = 729.3126, GNorm = 0.7012, lr_0 = 9.9559e-04
Validation auc = 0.701866
Epoch 6449
Loss = 9.9332e-03, PNorm = 729.3551, GNorm = 0.1983, lr_0 = 9.9559e-04
Loss = 5.8737e-02, PNorm = 729.3935, GNorm = 8.6974, lr_0 = 9.9559e-04
Validation auc = 0.700509
Epoch 6450
Loss = 4.8224e-02, PNorm = 729.4401, GNorm = 1.0131, lr_0 = 9.9558e-04
Validation auc = 0.697951
Epoch 6451
Loss = 5.2369e-02, PNorm = 729.4801, GNorm = 2.3964, lr_0 = 9.9558e-04
Validation auc = 0.691146
Epoch 6452
Loss = 5.5489e-02, PNorm = 729.5116, GNorm = 6.6912, lr_0 = 9.9558e-04
Validation auc = 0.697010
Epoch 6453
Loss = 5.5000e-02, PNorm = 729.5487, GNorm = 2.5251, lr_0 = 9.9558e-04
Validation auc = 0.693991
Epoch 6454
Loss = 1.8032e-02, PNorm = 729.5829, GNorm = 0.3821, lr_0 = 9.9558e-04
Validation auc = 0.688767
Epoch 6455
Loss = 2.9402e-02, PNorm = 729.6175, GNorm = 0.8669, lr_0 = 9.9558e-04
Validation auc = 0.685207
Epoch 6456
Loss = 9.5684e-02, PNorm = 729.6616, GNorm = 5.4539, lr_0 = 9.9558e-04
Validation auc = 0.683025
Epoch 6457
Loss = 5.6202e-02, PNorm = 729.7037, GNorm = 0.5995, lr_0 = 9.9558e-04
Validation auc = 0.686767
Epoch 6458
Loss = 7.8430e-02, PNorm = 729.7402, GNorm = 1.1676, lr_0 = 9.9558e-04
Validation auc = 0.688082
Epoch 6459
Loss = 2.5506e-02, PNorm = 729.7682, GNorm = 1.0795, lr_0 = 9.9558e-04
Loss = 2.5957e-02, PNorm = 729.7960, GNorm = 2.3476, lr_0 = 9.9558e-04
Validation auc = 0.689751
Epoch 6460
Loss = 4.5834e-02, PNorm = 729.8225, GNorm = 3.0638, lr_0 = 9.9558e-04
Validation auc = 0.695571
Epoch 6461
Loss = 5.4938e-02, PNorm = 729.8509, GNorm = 0.3160, lr_0 = 9.9558e-04
Validation auc = 0.700532
Epoch 6462
Loss = 3.2829e-02, PNorm = 729.8768, GNorm = 0.6951, lr_0 = 9.9558e-04
Validation auc = 0.702582
Epoch 6463
Loss = 2.2322e-02, PNorm = 729.9041, GNorm = 1.0350, lr_0 = 9.9558e-04
Validation auc = 0.700615
Epoch 6464
Loss = 2.2498e-02, PNorm = 729.9337, GNorm = 0.5036, lr_0 = 9.9557e-04
Validation auc = 0.703961
Epoch 6465
Loss = 3.9516e-02, PNorm = 729.9709, GNorm = 0.3736, lr_0 = 9.9557e-04
Validation auc = 0.702359
Epoch 6466
Loss = 6.4888e-02, PNorm = 730.0087, GNorm = 0.4584, lr_0 = 9.9557e-04
Validation auc = 0.700358
Epoch 6467
Loss = 2.0006e-02, PNorm = 730.0504, GNorm = 0.4304, lr_0 = 9.9557e-04
Validation auc = 0.696099
Epoch 6468
Loss = 2.3290e-02, PNorm = 730.0856, GNorm = 1.3878, lr_0 = 9.9557e-04
Validation auc = 0.693610
Epoch 6469
Loss = 4.1761e-02, PNorm = 730.1182, GNorm = 1.4327, lr_0 = 9.9557e-04
Loss = 2.8867e-02, PNorm = 730.1521, GNorm = 0.3409, lr_0 = 9.9557e-04
Validation auc = 0.693718
Epoch 6470
Loss = 3.5622e-02, PNorm = 730.1845, GNorm = 0.6584, lr_0 = 9.9557e-04
Validation auc = 0.695006
Epoch 6471
Loss = 1.9369e-02, PNorm = 730.2057, GNorm = 2.2343, lr_0 = 9.9557e-04
Validation auc = 0.693979
Epoch 6472
Loss = 1.7250e-02, PNorm = 730.2278, GNorm = 8.6341, lr_0 = 9.9557e-04
Validation auc = 0.697306
Epoch 6473
Loss = 2.5749e-02, PNorm = 730.2570, GNorm = 2.5483, lr_0 = 9.9557e-04
Validation auc = 0.699610
Epoch 6474
Loss = 2.2440e-02, PNorm = 730.2899, GNorm = 0.1951, lr_0 = 9.9557e-04
Validation auc = 0.702292
Epoch 6475
Loss = 2.6268e-02, PNorm = 730.3191, GNorm = 0.0843, lr_0 = 9.9557e-04
Validation auc = 0.716869
Epoch 6476
Loss = 4.7376e-02, PNorm = 730.3472, GNorm = 0.2970, lr_0 = 9.9557e-04
Validation auc = 0.719827
Epoch 6477
Loss = 6.0541e-02, PNorm = 730.3723, GNorm = 2.9521, lr_0 = 9.9556e-04
Validation auc = 0.716317
Epoch 6478
Loss = 3.4616e-02, PNorm = 730.4110, GNorm = 3.1644, lr_0 = 9.9556e-04
Validation auc = 0.713765
Epoch 6479
Loss = 6.6066e-02, PNorm = 730.4603, GNorm = 3.2584, lr_0 = 9.9556e-04
Loss = 5.8343e-02, PNorm = 730.5197, GNorm = 3.8096, lr_0 = 9.9556e-04
Validation auc = 0.706189
Epoch 6480
Loss = 1.1453e-01, PNorm = 730.5774, GNorm = 0.1851, lr_0 = 9.9556e-04
Validation auc = 0.699446
Epoch 6481
Loss = 1.2357e-01, PNorm = 730.6292, GNorm = 15.6764, lr_0 = 9.9556e-04
Validation auc = 0.707009
Epoch 6482
Loss = 4.9958e-02, PNorm = 730.6861, GNorm = 1.9351, lr_0 = 9.9556e-04
Validation auc = 0.722695
Epoch 6483
Loss = 1.0970e-01, PNorm = 730.7327, GNorm = 4.9127, lr_0 = 9.9556e-04
Validation auc = 0.724255
Epoch 6484
Loss = 5.7633e-02, PNorm = 730.7793, GNorm = 1.4394, lr_0 = 9.9556e-04
Validation auc = 0.727007
Epoch 6485
Loss = 4.8462e-02, PNorm = 730.8218, GNorm = 8.5502, lr_0 = 9.9556e-04
Validation auc = 0.719985
Epoch 6486
Loss = 1.2234e-01, PNorm = 730.8678, GNorm = 1.0131, lr_0 = 9.9556e-04
Validation auc = 0.717402
Epoch 6487
Loss = 2.6730e-02, PNorm = 730.9126, GNorm = 0.8250, lr_0 = 9.9556e-04
Validation auc = 0.715600
Epoch 6488
Loss = 1.2509e-02, PNorm = 730.9545, GNorm = 0.5537, lr_0 = 9.9556e-04
Validation auc = 0.712475
Epoch 6489
Loss = 1.6695e-02, PNorm = 730.9910, GNorm = 0.7676, lr_0 = 9.9556e-04
Loss = 4.3719e-02, PNorm = 731.0282, GNorm = 4.0211, lr_0 = 9.9556e-04
Validation auc = 0.709156
Epoch 6490
Loss = 7.3935e-02, PNorm = 731.0660, GNorm = 0.4494, lr_0 = 9.9555e-04
Validation auc = 0.711981
Epoch 6491
Loss = 1.8436e-02, PNorm = 731.0962, GNorm = 0.5059, lr_0 = 9.9555e-04
Validation auc = 0.713974
Epoch 6492
Loss = 2.0358e-02, PNorm = 731.1170, GNorm = 0.3716, lr_0 = 9.9555e-04
Validation auc = 0.713890
Epoch 6493
Loss = 4.4062e-02, PNorm = 731.1357, GNorm = 4.0983, lr_0 = 9.9555e-04
Validation auc = 0.709804
Epoch 6494
Loss = 9.7588e-02, PNorm = 731.1599, GNorm = 5.4885, lr_0 = 9.9555e-04
Validation auc = 0.707593
Epoch 6495
Loss = 1.1176e-01, PNorm = 731.2112, GNorm = 5.8673, lr_0 = 9.9555e-04
Validation auc = 0.689629
Epoch 6496
Loss = 1.3564e-02, PNorm = 731.2841, GNorm = 0.7215, lr_0 = 9.9555e-04
Validation auc = 0.676512
Epoch 6497
Loss = 2.8079e-02, PNorm = 731.3492, GNorm = 2.1573, lr_0 = 9.9555e-04
Validation auc = 0.667020
Epoch 6498
Loss = 2.8776e-02, PNorm = 731.4097, GNorm = 0.5695, lr_0 = 9.9555e-04
Validation auc = 0.670065
Epoch 6499
Loss = 1.0714e-02, PNorm = 731.4602, GNorm = 0.5030, lr_0 = 9.9555e-04
Loss = 1.0922e-01, PNorm = 731.5136, GNorm = 3.0010, lr_0 = 9.9555e-04
Validation auc = 0.677746
Epoch 6500
Loss = 5.1182e-02, PNorm = 731.5779, GNorm = 1.5871, lr_0 = 9.9555e-04
Validation auc = 0.682553
Epoch 6501
Loss = 2.9510e-02, PNorm = 731.6291, GNorm = 1.1775, lr_0 = 9.9555e-04
Validation auc = 0.690592
Epoch 6502
Loss = 6.8173e-02, PNorm = 731.6710, GNorm = 1.8896, lr_0 = 9.9555e-04
Validation auc = 0.692394
Epoch 6503
Loss = 3.3917e-02, PNorm = 731.7091, GNorm = 3.2893, lr_0 = 9.9554e-04
Validation auc = 0.695878
Epoch 6504
Loss = 4.4897e-02, PNorm = 731.7385, GNorm = 0.4551, lr_0 = 9.9554e-04
Validation auc = 0.695452
Epoch 6505
Loss = 5.3759e-02, PNorm = 731.7652, GNorm = 3.7233, lr_0 = 9.9554e-04
Validation auc = 0.697604
Epoch 6506
Loss = 6.2773e-02, PNorm = 731.8075, GNorm = 1.4874, lr_0 = 9.9554e-04
Validation auc = 0.697465
Epoch 6507
Loss = 6.4439e-02, PNorm = 731.8584, GNorm = 2.4013, lr_0 = 9.9554e-04
Validation auc = 0.704824
Epoch 6508
Loss = 6.2798e-02, PNorm = 731.9248, GNorm = 1.3529, lr_0 = 9.9554e-04
Validation auc = 0.712281
Epoch 6509
Loss = 9.6398e-03, PNorm = 731.9850, GNorm = 0.5108, lr_0 = 9.9554e-04
Loss = 6.2406e-02, PNorm = 732.0354, GNorm = 1.8739, lr_0 = 9.9554e-04
Validation auc = 0.718462
Epoch 6510
Loss = 7.5015e-02, PNorm = 732.0874, GNorm = 1.2700, lr_0 = 9.9554e-04
Validation auc = 0.708523
Epoch 6511
Loss = 5.1115e-02, PNorm = 732.1295, GNorm = 6.2767, lr_0 = 9.9554e-04
Validation auc = 0.707796
Epoch 6512
Loss = 3.5627e-02, PNorm = 732.1653, GNorm = 1.0733, lr_0 = 9.9554e-04
Validation auc = 0.713636
Epoch 6513
Loss = 4.3261e-02, PNorm = 732.1993, GNorm = 0.6019, lr_0 = 9.9554e-04
Validation auc = 0.718773
Epoch 6514
Loss = 4.3861e-02, PNorm = 732.2356, GNorm = 4.6862, lr_0 = 9.9554e-04
Validation auc = 0.719554
Epoch 6515
Loss = 6.0929e-02, PNorm = 732.2678, GNorm = 2.2071, lr_0 = 9.9554e-04
Validation auc = 0.713817
Epoch 6516
Loss = 5.9413e-02, PNorm = 732.3026, GNorm = 5.9628, lr_0 = 9.9554e-04
Validation auc = 0.705963
Epoch 6517
Loss = 2.3794e-02, PNorm = 732.3364, GNorm = 0.3777, lr_0 = 9.9553e-04
Validation auc = 0.708189
Epoch 6518
Loss = 7.3741e-03, PNorm = 732.3667, GNorm = 0.1032, lr_0 = 9.9553e-04
Validation auc = 0.706985
Epoch 6519
Loss = 1.3248e-02, PNorm = 732.3960, GNorm = 0.6263, lr_0 = 9.9553e-04
Loss = 2.6957e-02, PNorm = 732.4263, GNorm = 0.6496, lr_0 = 9.9553e-04
Validation auc = 0.706411
Epoch 6520
Loss = 5.8544e-02, PNorm = 732.4572, GNorm = 4.0079, lr_0 = 9.9553e-04
Validation auc = 0.710742
Epoch 6521
Loss = 1.8290e-02, PNorm = 732.4855, GNorm = 1.6198, lr_0 = 9.9553e-04
Validation auc = 0.712877
Epoch 6522
Loss = 3.9173e-02, PNorm = 732.5151, GNorm = 2.0989, lr_0 = 9.9553e-04
Validation auc = 0.715975
Epoch 6523
Loss = 5.6688e-02, PNorm = 732.5628, GNorm = 2.8493, lr_0 = 9.9553e-04
Validation auc = 0.719961
Epoch 6524
Loss = 4.3554e-02, PNorm = 732.6066, GNorm = 9.0073, lr_0 = 9.9553e-04
Validation auc = 0.717418
Epoch 6525
Loss = 2.3594e-02, PNorm = 732.6512, GNorm = 0.4057, lr_0 = 9.9553e-04
Validation auc = 0.712918
Epoch 6526
Loss = 1.0817e-02, PNorm = 732.6881, GNorm = 1.4725, lr_0 = 9.9553e-04
Validation auc = 0.709280
Epoch 6527
Loss = 3.4661e-02, PNorm = 732.7191, GNorm = 0.9957, lr_0 = 9.9553e-04
Validation auc = 0.702933
Epoch 6528
Loss = 1.3749e-02, PNorm = 732.7508, GNorm = 2.9883, lr_0 = 9.9553e-04
Validation auc = 0.698533
Epoch 6529
Loss = 2.3193e-02, PNorm = 732.7881, GNorm = 1.0280, lr_0 = 9.9553e-04
Loss = 5.2840e-02, PNorm = 732.8218, GNorm = 3.6250, lr_0 = 9.9553e-04
Validation auc = 0.698006
Epoch 6530
Loss = 3.1963e-02, PNorm = 732.8595, GNorm = 0.4483, lr_0 = 9.9552e-04
Validation auc = 0.698826
Epoch 6531
Loss = 4.1176e-02, PNorm = 732.8916, GNorm = 0.7998, lr_0 = 9.9552e-04
Validation auc = 0.696448
Epoch 6532
Loss = 6.6420e-02, PNorm = 732.9227, GNorm = 0.5509, lr_0 = 9.9552e-04
Validation auc = 0.700753
Epoch 6533
Loss = 2.2009e-02, PNorm = 732.9551, GNorm = 1.1566, lr_0 = 9.9552e-04
Validation auc = 0.708792
Epoch 6534
Loss = 2.1306e-02, PNorm = 732.9819, GNorm = 0.3026, lr_0 = 9.9552e-04
Validation auc = 0.706318
Epoch 6535
Loss = 3.3744e-02, PNorm = 733.0057, GNorm = 0.7946, lr_0 = 9.9552e-04
Validation auc = 0.702902
Epoch 6536
Loss = 3.4489e-02, PNorm = 733.0273, GNorm = 0.6380, lr_0 = 9.9552e-04
Validation auc = 0.703537
Epoch 6537
Loss = 3.4744e-02, PNorm = 733.0634, GNorm = 1.2624, lr_0 = 9.9552e-04
Validation auc = 0.703981
Epoch 6538
Loss = 2.8526e-02, PNorm = 733.1105, GNorm = 1.4227, lr_0 = 9.9552e-04
Validation auc = 0.697731
Epoch 6539
Loss = 2.4385e-02, PNorm = 733.1591, GNorm = 0.6826, lr_0 = 9.9552e-04
Loss = 1.4437e-02, PNorm = 733.1964, GNorm = 0.4298, lr_0 = 9.9552e-04
Validation auc = 0.694995
Epoch 6540
Loss = 5.7953e-02, PNorm = 733.2214, GNorm = 1.9616, lr_0 = 9.9552e-04
Validation auc = 0.702018
Epoch 6541
Loss = 2.5771e-02, PNorm = 733.2616, GNorm = 0.8627, lr_0 = 9.9552e-04
Validation auc = 0.707510
Epoch 6542
Loss = 1.2879e-02, PNorm = 733.2971, GNorm = 0.1251, lr_0 = 9.9552e-04
Validation auc = 0.706630
Epoch 6543
Loss = 4.2119e-02, PNorm = 733.3324, GNorm = 0.2112, lr_0 = 9.9551e-04
Validation auc = 0.707486
Epoch 6544
Loss = 4.8678e-02, PNorm = 733.3717, GNorm = 0.1776, lr_0 = 9.9551e-04
Validation auc = 0.706387
Epoch 6545
Loss = 4.3172e-02, PNorm = 733.4367, GNorm = 4.2062, lr_0 = 9.9551e-04
Validation auc = 0.708406
Epoch 6546
Loss = 1.0409e-02, PNorm = 733.5021, GNorm = 0.9731, lr_0 = 9.9551e-04
Validation auc = 0.709930
Epoch 6547
Loss = 4.9171e-02, PNorm = 733.5508, GNorm = 2.0615, lr_0 = 9.9551e-04
Validation auc = 0.710489
Epoch 6548
Loss = 2.8933e-02, PNorm = 733.5872, GNorm = 1.3529, lr_0 = 9.9551e-04
Validation auc = 0.710986
Epoch 6549
Loss = 1.6820e-02, PNorm = 733.6152, GNorm = 1.3270, lr_0 = 9.9551e-04
Loss = 8.8271e-02, PNorm = 733.6460, GNorm = 0.3900, lr_0 = 9.9551e-04
Validation auc = 0.710165
Epoch 6550
Loss = 2.6417e-02, PNorm = 733.6846, GNorm = 0.7563, lr_0 = 9.9551e-04
Validation auc = 0.709630
Epoch 6551
Loss = 2.0116e-02, PNorm = 733.7185, GNorm = 0.8853, lr_0 = 9.9551e-04
Validation auc = 0.703356
Epoch 6552
Loss = 3.7084e-02, PNorm = 733.7526, GNorm = 1.2532, lr_0 = 9.9551e-04
Validation auc = 0.699889
Epoch 6553
Loss = 4.8451e-02, PNorm = 733.7854, GNorm = 1.3280, lr_0 = 9.9551e-04
Validation auc = 0.699945
Epoch 6554
Loss = 1.9776e-02, PNorm = 733.8156, GNorm = 1.1762, lr_0 = 9.9551e-04
Validation auc = 0.698995
Epoch 6555
Loss = 4.4700e-02, PNorm = 733.8456, GNorm = 0.0927, lr_0 = 9.9551e-04
Validation auc = 0.702665
Epoch 6556
Loss = 6.7096e-02, PNorm = 733.8801, GNorm = 1.5190, lr_0 = 9.9551e-04
Validation auc = 0.705265
Epoch 6557
Loss = 3.1101e-02, PNorm = 733.9256, GNorm = 0.3160, lr_0 = 9.9550e-04
Validation auc = 0.697885
Epoch 6558
Loss = 2.2294e-02, PNorm = 733.9716, GNorm = 1.4098, lr_0 = 9.9550e-04
Validation auc = 0.686754
Epoch 6559
Loss = 1.3426e-02, PNorm = 734.0171, GNorm = 1.3011, lr_0 = 9.9550e-04
Loss = 6.2769e-02, PNorm = 734.0535, GNorm = 0.2634, lr_0 = 9.9550e-04
Validation auc = 0.683377
Epoch 6560
Loss = 6.2650e-02, PNorm = 734.1034, GNorm = 3.3004, lr_0 = 9.9550e-04
Validation auc = 0.687444
Epoch 6561
Loss = 5.5495e-02, PNorm = 734.1531, GNorm = 0.3637, lr_0 = 9.9550e-04
Validation auc = 0.691112
Epoch 6562
Loss = 1.2128e-01, PNorm = 734.1917, GNorm = 15.2622, lr_0 = 9.9550e-04
Validation auc = 0.692633
Epoch 6563
Loss = 3.0098e-02, PNorm = 734.2316, GNorm = 1.6888, lr_0 = 9.9550e-04
Validation auc = 0.692727
Epoch 6564
Loss = 3.7252e-02, PNorm = 734.2699, GNorm = 3.1356, lr_0 = 9.9550e-04
Validation auc = 0.687533
Epoch 6565
Loss = 3.0040e-02, PNorm = 734.3101, GNorm = 0.3213, lr_0 = 9.9550e-04
Validation auc = 0.678770
Epoch 6566
Loss = 9.0198e-02, PNorm = 734.3495, GNorm = 1.9763, lr_0 = 9.9550e-04
Validation auc = 0.671986
Epoch 6567
Loss = 2.5120e-02, PNorm = 734.3921, GNorm = 0.6607, lr_0 = 9.9550e-04
Validation auc = 0.669640
Epoch 6568
Loss = 6.4681e-02, PNorm = 734.4345, GNorm = 1.8341, lr_0 = 9.9550e-04
Validation auc = 0.674434
Epoch 6569
Loss = 3.5539e-02, PNorm = 734.4767, GNorm = 1.0823, lr_0 = 9.9550e-04
Loss = 3.2868e-02, PNorm = 734.5101, GNorm = 0.2252, lr_0 = 9.9549e-04
Validation auc = 0.677005
Epoch 6570
Loss = 2.7252e-02, PNorm = 734.5416, GNorm = 2.1466, lr_0 = 9.9549e-04
Validation auc = 0.679256
Epoch 6571
Loss = 2.9208e-02, PNorm = 734.5687, GNorm = 0.2427, lr_0 = 9.9549e-04
Validation auc = 0.685839
Epoch 6572
Loss = 4.3922e-02, PNorm = 734.5973, GNorm = 0.3813, lr_0 = 9.9549e-04
Validation auc = 0.687583
Epoch 6573
Loss = 6.5797e-02, PNorm = 734.6239, GNorm = 2.6859, lr_0 = 9.9549e-04
Validation auc = 0.689019
Epoch 6574
Loss = 4.5658e-02, PNorm = 734.6619, GNorm = 3.1460, lr_0 = 9.9549e-04
Validation auc = 0.690582
Epoch 6575
Loss = 1.7044e-02, PNorm = 734.6998, GNorm = 1.5755, lr_0 = 9.9549e-04
Validation auc = 0.687197
Epoch 6576
Loss = 3.1816e-02, PNorm = 734.7327, GNorm = 1.1633, lr_0 = 9.9549e-04
Validation auc = 0.682193
Epoch 6577
Loss = 3.5210e-02, PNorm = 734.7723, GNorm = 3.6138, lr_0 = 9.9549e-04
Validation auc = 0.689927
Epoch 6578
Loss = 2.0579e-02, PNorm = 734.8181, GNorm = 0.9245, lr_0 = 9.9549e-04
Validation auc = 0.696167
Epoch 6579
Loss = 4.4695e-02, PNorm = 734.8561, GNorm = 1.9362, lr_0 = 9.9549e-04
Loss = 8.0520e-02, PNorm = 734.8945, GNorm = 1.5969, lr_0 = 9.9549e-04
Validation auc = 0.697583
Epoch 6580
Loss = 2.2515e-02, PNorm = 734.9394, GNorm = 0.9557, lr_0 = 9.9549e-04
Validation auc = 0.699765
Epoch 6581
Loss = 4.3443e-02, PNorm = 734.9748, GNorm = 3.1531, lr_0 = 9.9549e-04
Validation auc = 0.703926
Epoch 6582
Loss = 2.1434e-02, PNorm = 735.0105, GNorm = 0.6151, lr_0 = 9.9549e-04
Validation auc = 0.702834
Epoch 6583
Loss = 5.3885e-02, PNorm = 735.0411, GNorm = 1.6726, lr_0 = 9.9548e-04
Validation auc = 0.695951
Epoch 6584
Loss = 2.7961e-02, PNorm = 735.0766, GNorm = 0.6785, lr_0 = 9.9548e-04
Validation auc = 0.691897
Epoch 6585
Loss = 2.9023e-02, PNorm = 735.1067, GNorm = 2.5545, lr_0 = 9.9548e-04
Validation auc = 0.690860
Epoch 6586
Loss = 5.5885e-02, PNorm = 735.1312, GNorm = 1.8404, lr_0 = 9.9548e-04
Validation auc = 0.689663
Epoch 6587
Loss = 8.0178e-02, PNorm = 735.1656, GNorm = 3.5366, lr_0 = 9.9548e-04
Validation auc = 0.688766
Epoch 6588
Loss = 8.5159e-03, PNorm = 735.2149, GNorm = 0.7209, lr_0 = 9.9548e-04
Validation auc = 0.683396
Epoch 6589
Loss = 3.1304e-03, PNorm = 735.2629, GNorm = 0.2374, lr_0 = 9.9548e-04
Loss = 3.5556e-02, PNorm = 735.3064, GNorm = 1.3842, lr_0 = 9.9548e-04
Validation auc = 0.679354
Epoch 6590
Loss = 4.0819e-02, PNorm = 735.3427, GNorm = 4.4701, lr_0 = 9.9548e-04
Validation auc = 0.681511
Epoch 6591
Loss = 7.7678e-02, PNorm = 735.3854, GNorm = 0.6322, lr_0 = 9.9548e-04
Validation auc = 0.692133
Epoch 6592
Loss = 6.3164e-02, PNorm = 735.4369, GNorm = 2.5424, lr_0 = 9.9548e-04
Validation auc = 0.698877
Epoch 6593
Loss = 2.5182e-02, PNorm = 735.4847, GNorm = 0.5997, lr_0 = 9.9548e-04
Validation auc = 0.703763
Epoch 6594
Loss = 1.0355e-02, PNorm = 735.5187, GNorm = 0.4308, lr_0 = 9.9548e-04
Validation auc = 0.706186
Epoch 6595
Loss = 2.4784e-02, PNorm = 735.5493, GNorm = 0.8633, lr_0 = 9.9548e-04
Validation auc = 0.709766
Epoch 6596
Loss = 1.1367e-01, PNorm = 735.5854, GNorm = 8.8573, lr_0 = 9.9548e-04
Validation auc = 0.702220
Epoch 6597
Loss = 8.3568e-03, PNorm = 735.6352, GNorm = 0.6203, lr_0 = 9.9547e-04
Validation auc = 0.694739
Epoch 6598
Loss = 3.3485e-02, PNorm = 735.6934, GNorm = 1.2404, lr_0 = 9.9547e-04
Validation auc = 0.692763
Epoch 6599
Loss = 4.5994e-02, PNorm = 735.7586, GNorm = 3.0680, lr_0 = 9.9547e-04
Loss = 3.6447e-02, PNorm = 735.8265, GNorm = 0.1362, lr_0 = 9.9547e-04
Validation auc = 0.694642
Epoch 6600
Loss = 2.0150e-02, PNorm = 735.8781, GNorm = 0.4329, lr_0 = 9.9547e-04
Validation auc = 0.692214
Epoch 6601
Loss = 4.4602e-02, PNorm = 735.9230, GNorm = 2.4824, lr_0 = 9.9547e-04
Validation auc = 0.691280
Epoch 6602
Loss = 2.7988e-02, PNorm = 735.9666, GNorm = 0.6625, lr_0 = 9.9547e-04
Validation auc = 0.689110
Epoch 6603
Loss = 3.6004e-02, PNorm = 736.0045, GNorm = 4.3491, lr_0 = 9.9547e-04
Validation auc = 0.684836
Epoch 6604
Loss = 3.5019e-02, PNorm = 736.0506, GNorm = 2.8949, lr_0 = 9.9547e-04
Validation auc = 0.686938
Epoch 6605
Loss = 7.8978e-02, PNorm = 736.0903, GNorm = 0.9615, lr_0 = 9.9547e-04
Validation auc = 0.687831
Epoch 6606
Loss = 6.4033e-02, PNorm = 736.1263, GNorm = 1.5298, lr_0 = 9.9547e-04
Validation auc = 0.687609
Epoch 6607
Loss = 8.6431e-03, PNorm = 736.1568, GNorm = 0.7464, lr_0 = 9.9547e-04
Validation auc = 0.688399
Epoch 6608
Loss = 8.5479e-03, PNorm = 736.1874, GNorm = 0.1739, lr_0 = 9.9547e-04
Validation auc = 0.687130
Epoch 6609
Loss = 1.2972e-02, PNorm = 736.2211, GNorm = 0.8724, lr_0 = 9.9547e-04
Loss = 3.5716e-02, PNorm = 736.2555, GNorm = 3.6190, lr_0 = 9.9546e-04
Validation auc = 0.690716
Epoch 6610
Loss = 3.5173e-02, PNorm = 736.2882, GNorm = 1.2478, lr_0 = 9.9546e-04
Validation auc = 0.693128
Epoch 6611
Loss = 7.7472e-02, PNorm = 736.3207, GNorm = 3.4815, lr_0 = 9.9546e-04
Validation auc = 0.694886
Epoch 6612
Loss = 2.6903e-02, PNorm = 736.3597, GNorm = 0.6467, lr_0 = 9.9546e-04
Validation auc = 0.702101
Epoch 6613
Loss = 2.2842e-02, PNorm = 736.3960, GNorm = 1.1573, lr_0 = 9.9546e-04
Validation auc = 0.707077
Epoch 6614
Loss = 9.9802e-02, PNorm = 736.4317, GNorm = 1.1161, lr_0 = 9.9546e-04
Validation auc = 0.710256
Epoch 6615
Loss = 4.5960e-02, PNorm = 736.4730, GNorm = 1.1072, lr_0 = 9.9546e-04
Validation auc = 0.708254
Epoch 6616
Loss = 2.4369e-02, PNorm = 736.5089, GNorm = 2.4410, lr_0 = 9.9546e-04
Validation auc = 0.706226
Epoch 6617
Loss = 3.9727e-02, PNorm = 736.5388, GNorm = 1.4260, lr_0 = 9.9546e-04
Validation auc = 0.708007
Epoch 6618
Loss = 1.3848e-02, PNorm = 736.5833, GNorm = 1.0265, lr_0 = 9.9546e-04
Validation auc = 0.708483
Epoch 6619
Loss = 3.6148e-02, PNorm = 736.6271, GNorm = 1.9839, lr_0 = 9.9546e-04
Loss = 3.5330e-02, PNorm = 736.6622, GNorm = 0.4423, lr_0 = 9.9546e-04
Validation auc = 0.710769
Epoch 6620
Loss = 3.3568e-02, PNorm = 736.6987, GNorm = 0.5378, lr_0 = 9.9546e-04
Validation auc = 0.704499
Epoch 6621
Loss = 4.0293e-02, PNorm = 736.7389, GNorm = 0.1541, lr_0 = 9.9546e-04
Validation auc = 0.701111
Epoch 6622
Loss = 1.8495e-02, PNorm = 736.7824, GNorm = 0.8154, lr_0 = 9.9546e-04
Validation auc = 0.701698
Epoch 6623
Loss = 1.5908e-02, PNorm = 736.8190, GNorm = 0.3637, lr_0 = 9.9545e-04
Validation auc = 0.700801
Epoch 6624
Loss = 5.1264e-03, PNorm = 736.8516, GNorm = 0.9053, lr_0 = 9.9545e-04
Validation auc = 0.702268
Epoch 6625
Loss = 2.6826e-02, PNorm = 736.8832, GNorm = 0.6037, lr_0 = 9.9545e-04
Validation auc = 0.706887
Epoch 6626
Loss = 8.3349e-03, PNorm = 736.9114, GNorm = 0.0844, lr_0 = 9.9545e-04
Validation auc = 0.702284
Epoch 6627
Loss = 1.9803e-01, PNorm = 736.9427, GNorm = 3.2331, lr_0 = 9.9545e-04
Validation auc = 0.697709
Epoch 6628
Loss = 1.2483e-02, PNorm = 736.9847, GNorm = 0.2362, lr_0 = 9.9545e-04
Validation auc = 0.696821
Epoch 6629
Loss = 1.9646e-03, PNorm = 737.0229, GNorm = 0.1236, lr_0 = 9.9545e-04
Loss = 4.3596e-02, PNorm = 737.0727, GNorm = 2.7514, lr_0 = 9.9545e-04
Validation auc = 0.711541
Epoch 6630
Loss = 5.7773e-02, PNorm = 737.1252, GNorm = 1.5867, lr_0 = 9.9545e-04
Validation auc = 0.715609
Epoch 6631
Loss = 4.3056e-02, PNorm = 737.1789, GNorm = 3.0991, lr_0 = 9.9545e-04
Validation auc = 0.707224
Epoch 6632
Loss = 4.9752e-02, PNorm = 737.2240, GNorm = 4.5507, lr_0 = 9.9545e-04
Validation auc = 0.703472
Epoch 6633
Loss = 8.0152e-02, PNorm = 737.2643, GNorm = 12.0713, lr_0 = 9.9545e-04
Validation auc = 0.708224
Epoch 6634
Loss = 1.8313e-02, PNorm = 737.3129, GNorm = 1.1457, lr_0 = 9.9545e-04
Validation auc = 0.710366
Epoch 6635
Loss = 2.0241e-02, PNorm = 737.3756, GNorm = 1.3181, lr_0 = 9.9545e-04
Validation auc = 0.708081
Epoch 6636
Loss = 2.2854e-02, PNorm = 737.4472, GNorm = 0.7190, lr_0 = 9.9544e-04
Validation auc = 0.706408
Epoch 6637
Loss = 1.2918e-01, PNorm = 737.5051, GNorm = 0.7413, lr_0 = 9.9544e-04
Validation auc = 0.703171
Epoch 6638
Loss = 1.3815e-02, PNorm = 737.5575, GNorm = 0.3430, lr_0 = 9.9544e-04
Validation auc = 0.699116
Epoch 6639
Loss = 1.8958e-02, PNorm = 737.5932, GNorm = 0.6745, lr_0 = 9.9544e-04
Loss = 1.9675e-02, PNorm = 737.6211, GNorm = 0.2526, lr_0 = 9.9544e-04
Validation auc = 0.699414
Epoch 6640
Loss = 4.8483e-02, PNorm = 737.6427, GNorm = 10.2411, lr_0 = 9.9544e-04
Validation auc = 0.694599
Epoch 6641
Loss = 2.0977e-02, PNorm = 737.6783, GNorm = 1.7261, lr_0 = 9.9544e-04
Validation auc = 0.691069
Epoch 6642
Loss = 3.5401e-02, PNorm = 737.7098, GNorm = 0.1384, lr_0 = 9.9544e-04
Validation auc = 0.691160
Epoch 6643
Loss = 8.7307e-02, PNorm = 737.7478, GNorm = 3.3377, lr_0 = 9.9544e-04
Validation auc = 0.700222
Epoch 6644
Loss = 1.6579e-02, PNorm = 737.7898, GNorm = 1.2989, lr_0 = 9.9544e-04
Validation auc = 0.708608
Epoch 6645
Loss = 3.5034e-02, PNorm = 737.8269, GNorm = 1.6743, lr_0 = 9.9544e-04
Validation auc = 0.712246
Epoch 6646
Loss = 5.7662e-02, PNorm = 737.8663, GNorm = 2.3052, lr_0 = 9.9544e-04
Validation auc = 0.707258
Epoch 6647
Loss = 2.3206e-02, PNorm = 737.9161, GNorm = 0.9019, lr_0 = 9.9544e-04
Validation auc = 0.704949
Epoch 6648
Loss = 5.5189e-02, PNorm = 737.9696, GNorm = 4.3362, lr_0 = 9.9544e-04
Validation auc = 0.703431
Epoch 6649
Loss = 4.5047e-02, PNorm = 738.0191, GNorm = 3.6133, lr_0 = 9.9544e-04
Loss = 5.8029e-02, PNorm = 738.0700, GNorm = 4.3111, lr_0 = 9.9543e-04
Validation auc = 0.701952
Epoch 6650
Loss = 6.1469e-02, PNorm = 738.1283, GNorm = 5.8975, lr_0 = 9.9543e-04
Validation auc = 0.697405
Epoch 6651
Loss = 6.0971e-02, PNorm = 738.2052, GNorm = 1.2304, lr_0 = 9.9543e-04
Validation auc = 0.703469
Epoch 6652
Loss = 2.5423e-02, PNorm = 738.2755, GNorm = 0.5231, lr_0 = 9.9543e-04
Validation auc = 0.698922
Epoch 6653
Loss = 7.4770e-02, PNorm = 738.3285, GNorm = 4.0731, lr_0 = 9.9543e-04
Validation auc = 0.697553
Epoch 6654
Loss = 4.3248e-02, PNorm = 738.3803, GNorm = 1.1065, lr_0 = 9.9543e-04
Validation auc = 0.698085
Epoch 6655
Loss = 4.7492e-02, PNorm = 738.4247, GNorm = 10.8371, lr_0 = 9.9543e-04
Validation auc = 0.687248
Epoch 6656
Loss = 8.2456e-02, PNorm = 738.4763, GNorm = 2.7758, lr_0 = 9.9543e-04
Validation auc = 0.683636
Epoch 6657
Loss = 1.0159e-01, PNorm = 738.5591, GNorm = 3.5655, lr_0 = 9.9543e-04
Validation auc = 0.690831
Epoch 6658
Loss = 1.1086e-01, PNorm = 738.6283, GNorm = 4.4313, lr_0 = 9.9543e-04
Validation auc = 0.700355
Epoch 6659
Loss = 1.8003e-02, PNorm = 738.6858, GNorm = 0.7982, lr_0 = 9.9543e-04
Loss = 8.5826e-02, PNorm = 738.7472, GNorm = 1.3706, lr_0 = 9.9543e-04
Validation auc = 0.702823
Epoch 6660
Loss = 5.6368e-02, PNorm = 738.7999, GNorm = 3.4951, lr_0 = 9.9543e-04
Validation auc = 0.701139
Epoch 6661
Loss = 1.0350e-01, PNorm = 738.8471, GNorm = 1.5402, lr_0 = 9.9543e-04
Validation auc = 0.700090
Epoch 6662
Loss = 4.7941e-02, PNorm = 738.8983, GNorm = 0.5761, lr_0 = 9.9542e-04
Validation auc = 0.703732
Epoch 6663
Loss = 6.3497e-02, PNorm = 738.9407, GNorm = 1.2576, lr_0 = 9.9542e-04
Validation auc = 0.706272
Epoch 6664
Loss = 2.9647e-02, PNorm = 738.9746, GNorm = 2.0479, lr_0 = 9.9542e-04
Validation auc = 0.709465
Epoch 6665
Loss = 9.1490e-02, PNorm = 739.0124, GNorm = 1.2965, lr_0 = 9.9542e-04
Validation auc = 0.708822
Epoch 6666
Loss = 2.7799e-02, PNorm = 739.0724, GNorm = 0.5050, lr_0 = 9.9542e-04
Validation auc = 0.714586
Epoch 6667
Loss = 3.6065e-02, PNorm = 739.1205, GNorm = 1.4750, lr_0 = 9.9542e-04
Validation auc = 0.712284
Epoch 6668
Loss = 1.0235e-02, PNorm = 739.1670, GNorm = 0.6114, lr_0 = 9.9542e-04
Validation auc = 0.712564
Epoch 6669
Loss = 1.1109e-02, PNorm = 739.2263, GNorm = 0.8373, lr_0 = 9.9542e-04
Loss = 2.8972e-02, PNorm = 739.2689, GNorm = 2.8438, lr_0 = 9.9542e-04
Validation auc = 0.710167
Epoch 6670
Loss = 2.4420e-02, PNorm = 739.3017, GNorm = 0.2636, lr_0 = 9.9542e-04
Validation auc = 0.707324
Epoch 6671
Loss = 6.9444e-02, PNorm = 739.3358, GNorm = 1.7373, lr_0 = 9.9542e-04
Validation auc = 0.701312
Epoch 6672
Loss = 5.4837e-02, PNorm = 739.3790, GNorm = 0.7250, lr_0 = 9.9542e-04
Validation auc = 0.697103
Epoch 6673
Loss = 4.4406e-02, PNorm = 739.4242, GNorm = 3.7836, lr_0 = 9.9542e-04
Validation auc = 0.693133
Epoch 6674
Loss = 7.1801e-02, PNorm = 739.4873, GNorm = 2.1754, lr_0 = 9.9542e-04
Validation auc = 0.703476
Epoch 6675
Loss = 3.9690e-02, PNorm = 739.5726, GNorm = 0.1868, lr_0 = 9.9542e-04
Validation auc = 0.698686
Epoch 6676
Loss = 7.6114e-02, PNorm = 739.6633, GNorm = 6.2735, lr_0 = 9.9541e-04
Validation auc = 0.703915
Epoch 6677
Loss = 7.7852e-02, PNorm = 739.7342, GNorm = 0.6109, lr_0 = 9.9541e-04
Validation auc = 0.714059
Epoch 6678
Loss = 1.8725e-01, PNorm = 739.7876, GNorm = 4.8122, lr_0 = 9.9541e-04
Validation auc = 0.718764
Epoch 6679
Loss = 6.6895e-02, PNorm = 739.8449, GNorm = 9.0919, lr_0 = 9.9541e-04
Loss = 8.1001e-02, PNorm = 739.9038, GNorm = 4.4320, lr_0 = 9.9541e-04
Validation auc = 0.714393
Epoch 6680
Loss = 3.0160e-02, PNorm = 739.9538, GNorm = 0.5595, lr_0 = 9.9541e-04
Validation auc = 0.716896
Epoch 6681
Loss = 8.6220e-02, PNorm = 739.9967, GNorm = 4.1595, lr_0 = 9.9541e-04
Validation auc = 0.712828
Epoch 6682
Loss = 5.4986e-02, PNorm = 740.0462, GNorm = 10.0874, lr_0 = 9.9541e-04
Validation auc = 0.710153
Epoch 6683
Loss = 3.4083e-02, PNorm = 740.1004, GNorm = 0.6557, lr_0 = 9.9541e-04
Validation auc = 0.715572
Epoch 6684
Loss = 4.9912e-02, PNorm = 740.1491, GNorm = 0.3899, lr_0 = 9.9541e-04
Validation auc = 0.712412
Epoch 6685
Loss = 5.1436e-02, PNorm = 740.1956, GNorm = 1.3816, lr_0 = 9.9541e-04
Validation auc = 0.706177
Epoch 6686
Loss = 1.1999e-02, PNorm = 740.2358, GNorm = 0.9406, lr_0 = 9.9541e-04
Validation auc = 0.706771
Epoch 6687
Loss = 1.1560e-01, PNorm = 740.2722, GNorm = 7.4607, lr_0 = 9.9541e-04
Validation auc = 0.701086
Epoch 6688
Loss = 7.1668e-02, PNorm = 740.3268, GNorm = 4.5724, lr_0 = 9.9541e-04
Validation auc = 0.689743
Epoch 6689
Loss = 1.8389e-02, PNorm = 740.3833, GNorm = 0.6894, lr_0 = 9.9541e-04
Loss = 5.4520e-02, PNorm = 740.4438, GNorm = 0.7686, lr_0 = 9.9540e-04
Validation auc = 0.698101
Epoch 6690
Loss = 7.2418e-02, PNorm = 740.5046, GNorm = 3.2647, lr_0 = 9.9540e-04
Validation auc = 0.700263
Epoch 6691
Loss = 2.9983e-02, PNorm = 740.5533, GNorm = 2.7023, lr_0 = 9.9540e-04
Validation auc = 0.700036
Epoch 6692
Loss = 3.8734e-02, PNorm = 740.5919, GNorm = 0.1828, lr_0 = 9.9540e-04
Validation auc = 0.700794
Epoch 6693
Loss = 5.9043e-02, PNorm = 740.6328, GNorm = 1.0856, lr_0 = 9.9540e-04
Validation auc = 0.703094
Epoch 6694
Loss = 5.7024e-02, PNorm = 740.6992, GNorm = 0.5897, lr_0 = 9.9540e-04
Validation auc = 0.696819
Epoch 6695
Loss = 2.6060e-02, PNorm = 740.7585, GNorm = 1.0237, lr_0 = 9.9540e-04
Validation auc = 0.699654
Epoch 6696
Loss = 6.3028e-02, PNorm = 740.8083, GNorm = 4.6791, lr_0 = 9.9540e-04
Validation auc = 0.701914
Epoch 6697
Loss = 5.3922e-02, PNorm = 740.8544, GNorm = 1.4519, lr_0 = 9.9540e-04
Validation auc = 0.696503
Epoch 6698
Loss = 5.4140e-02, PNorm = 740.9042, GNorm = 5.5074, lr_0 = 9.9540e-04
Validation auc = 0.704501
Epoch 6699
Loss = 8.3744e-02, PNorm = 740.9638, GNorm = 1.7697, lr_0 = 9.9540e-04
Loss = 8.3544e-02, PNorm = 741.0272, GNorm = 3.3950, lr_0 = 9.9540e-04
Validation auc = 0.709504
Epoch 6700
Loss = 4.5613e-02, PNorm = 741.0806, GNorm = 5.2631, lr_0 = 9.9540e-04
Validation auc = 0.711635
Epoch 6701
Loss = 2.5808e-02, PNorm = 741.1241, GNorm = 0.2812, lr_0 = 9.9540e-04
Validation auc = 0.717854
Epoch 6702
Loss = 6.3486e-02, PNorm = 741.1676, GNorm = 0.9731, lr_0 = 9.9539e-04
Validation auc = 0.707354
Epoch 6703
Loss = 5.6562e-02, PNorm = 741.2194, GNorm = 0.8194, lr_0 = 9.9539e-04
Validation auc = 0.701535
Epoch 6704
Loss = 6.1398e-02, PNorm = 741.2571, GNorm = 3.6981, lr_0 = 9.9539e-04
Validation auc = 0.698985
Epoch 6705
Loss = 9.8829e-02, PNorm = 741.3004, GNorm = 0.7971, lr_0 = 9.9539e-04
Validation auc = 0.693694
Epoch 6706
Loss = 3.0310e-02, PNorm = 741.3546, GNorm = 2.1163, lr_0 = 9.9539e-04
Validation auc = 0.696799
Epoch 6707
Loss = 3.8370e-02, PNorm = 741.4130, GNorm = 0.8477, lr_0 = 9.9539e-04
Validation auc = 0.703627
Epoch 6708
Loss = 2.5063e-02, PNorm = 741.4620, GNorm = 1.7571, lr_0 = 9.9539e-04
Validation auc = 0.702225
Epoch 6709
Loss = 8.7648e-03, PNorm = 741.5285, GNorm = 0.4741, lr_0 = 9.9539e-04
Loss = 4.6026e-02, PNorm = 741.5870, GNorm = 0.5325, lr_0 = 9.9539e-04
Validation auc = 0.703107
Epoch 6710
Loss = 4.9097e-02, PNorm = 741.6281, GNorm = 2.2412, lr_0 = 9.9539e-04
Validation auc = 0.702617
Epoch 6711
Loss = 1.2977e-01, PNorm = 741.6728, GNorm = 4.3579, lr_0 = 9.9539e-04
Validation auc = 0.697598
Epoch 6712
Loss = 6.2898e-02, PNorm = 741.7213, GNorm = 26.1929, lr_0 = 9.9539e-04
Validation auc = 0.700192
Epoch 6713
Loss = 3.9164e-02, PNorm = 741.7834, GNorm = 0.8728, lr_0 = 9.9539e-04
Validation auc = 0.694705
Epoch 6714
Loss = 8.8773e-02, PNorm = 741.8436, GNorm = 1.4959, lr_0 = 9.9539e-04
Validation auc = 0.697079
Epoch 6715
Loss = 9.4257e-02, PNorm = 741.9118, GNorm = 1.0362, lr_0 = 9.9539e-04
Validation auc = 0.702347
Epoch 6716
Loss = 6.4188e-02, PNorm = 741.9749, GNorm = 3.8844, lr_0 = 9.9538e-04
Validation auc = 0.698448
Epoch 6717
Loss = 3.7168e-02, PNorm = 742.0325, GNorm = 0.5853, lr_0 = 9.9538e-04
Validation auc = 0.679420
Epoch 6718
Loss = 3.6728e-02, PNorm = 742.1023, GNorm = 1.3479, lr_0 = 9.9538e-04
Validation auc = 0.673364
Epoch 6719
Loss = 2.8637e-02, PNorm = 742.1594, GNorm = 0.6611, lr_0 = 9.9538e-04
Loss = 5.9312e-02, PNorm = 742.2096, GNorm = 0.6277, lr_0 = 9.9538e-04
Validation auc = 0.679229
Epoch 6720
Loss = 4.5144e-02, PNorm = 742.2611, GNorm = 2.4104, lr_0 = 9.9538e-04
Validation auc = 0.686777
Epoch 6721
Loss = 3.6776e-02, PNorm = 742.3161, GNorm = 0.2984, lr_0 = 9.9538e-04
Validation auc = 0.696605
Epoch 6722
Loss = 7.8056e-02, PNorm = 742.3574, GNorm = 0.5579, lr_0 = 9.9538e-04
Validation auc = 0.703815
Epoch 6723
Loss = 2.2133e-02, PNorm = 742.3992, GNorm = 2.4743, lr_0 = 9.9538e-04
Validation auc = 0.703514
Epoch 6724
Loss = 2.5745e-02, PNorm = 742.4421, GNorm = 1.5011, lr_0 = 9.9538e-04
Validation auc = 0.698564
Epoch 6725
Loss = 4.3729e-02, PNorm = 742.4840, GNorm = 10.3466, lr_0 = 9.9538e-04
Validation auc = 0.688089
Epoch 6726
Loss = 3.6837e-02, PNorm = 742.5337, GNorm = 2.6969, lr_0 = 9.9538e-04
Validation auc = 0.682672
Epoch 6727
Loss = 9.8864e-03, PNorm = 742.5825, GNorm = 0.6189, lr_0 = 9.9538e-04
Validation auc = 0.680401
Epoch 6728
Loss = 7.6671e-03, PNorm = 742.6217, GNorm = 0.3512, lr_0 = 9.9538e-04
Validation auc = 0.680266
Epoch 6729
Loss = 1.9981e-02, PNorm = 742.6498, GNorm = 1.0663, lr_0 = 9.9537e-04
Loss = 8.7194e-02, PNorm = 742.6766, GNorm = 8.8493, lr_0 = 9.9537e-04
Validation auc = 0.685727
Epoch 6730
Loss = 2.4348e-02, PNorm = 742.7072, GNorm = 1.5533, lr_0 = 9.9537e-04
Validation auc = 0.692823
Epoch 6731
Loss = 1.0032e-01, PNorm = 742.7417, GNorm = 1.8617, lr_0 = 9.9537e-04
Validation auc = 0.695338
Epoch 6732
Loss = 6.6480e-02, PNorm = 742.7814, GNorm = 1.6942, lr_0 = 9.9537e-04
Validation auc = 0.702918
Epoch 6733
Loss = 2.2650e-02, PNorm = 742.8245, GNorm = 1.1743, lr_0 = 9.9537e-04
Validation auc = 0.704186
Epoch 6734
Loss = 9.4805e-02, PNorm = 742.8665, GNorm = 5.5216, lr_0 = 9.9537e-04
Validation auc = 0.701289
Epoch 6735
Loss = 2.3524e-02, PNorm = 742.9137, GNorm = 0.7334, lr_0 = 9.9537e-04
Validation auc = 0.701885
Epoch 6736
Loss = 4.0798e-02, PNorm = 742.9623, GNorm = 0.5988, lr_0 = 9.9537e-04
Validation auc = 0.702418
Epoch 6737
Loss = 2.9554e-02, PNorm = 743.0216, GNorm = 0.4147, lr_0 = 9.9537e-04
Validation auc = 0.702161
Epoch 6738
Loss = 3.5370e-02, PNorm = 743.0733, GNorm = 0.2179, lr_0 = 9.9537e-04
Validation auc = 0.701794
Epoch 6739
Loss = 6.3227e-02, PNorm = 743.1097, GNorm = 3.2625, lr_0 = 9.9537e-04
Loss = 7.0860e-02, PNorm = 743.1393, GNorm = 4.6659, lr_0 = 9.9537e-04
Validation auc = 0.698356
Epoch 6740
Loss = 4.1987e-02, PNorm = 743.1747, GNorm = 3.1196, lr_0 = 9.9537e-04
Validation auc = 0.703303
Epoch 6741
Loss = 7.6975e-02, PNorm = 743.2225, GNorm = 1.4241, lr_0 = 9.9537e-04
Validation auc = 0.699220
Epoch 6742
Loss = 7.0923e-02, PNorm = 743.2731, GNorm = 8.1764, lr_0 = 9.9536e-04
Validation auc = 0.696634
Epoch 6743
Loss = 7.1834e-02, PNorm = 743.3207, GNorm = 4.4904, lr_0 = 9.9536e-04
Validation auc = 0.697156
Epoch 6744
Loss = 6.7716e-02, PNorm = 743.3719, GNorm = 9.8951, lr_0 = 9.9536e-04
Validation auc = 0.699804
Epoch 6745
Loss = 5.1511e-02, PNorm = 743.4322, GNorm = 0.2076, lr_0 = 9.9536e-04
Validation auc = 0.699600
Epoch 6746
Loss = 7.4802e-02, PNorm = 743.4779, GNorm = 3.5435, lr_0 = 9.9536e-04
Validation auc = 0.698257
Epoch 6747
Loss = 1.3501e-02, PNorm = 743.5161, GNorm = 0.6220, lr_0 = 9.9536e-04
Validation auc = 0.694671
Epoch 6748
Loss = 1.3559e-02, PNorm = 743.5533, GNorm = 0.2026, lr_0 = 9.9536e-04
Validation auc = 0.694994
Epoch 6749
Loss = 1.2219e-02, PNorm = 743.5878, GNorm = 0.6871, lr_0 = 9.9536e-04
Loss = 5.4209e-02, PNorm = 743.6228, GNorm = 3.0913, lr_0 = 9.9536e-04
Validation auc = 0.688615
Epoch 6750
Loss = 3.5450e-02, PNorm = 743.6692, GNorm = 0.1115, lr_0 = 9.9536e-04
Validation auc = 0.690384
Epoch 6751
Loss = 3.3683e-02, PNorm = 743.7203, GNorm = 2.9062, lr_0 = 9.9536e-04
Validation auc = 0.691046
Epoch 6752
Loss = 3.5319e-02, PNorm = 743.7686, GNorm = 4.2869, lr_0 = 9.9536e-04
Validation auc = 0.694313
Epoch 6753
Loss = 3.2292e-02, PNorm = 743.8119, GNorm = 0.2760, lr_0 = 9.9536e-04
Validation auc = 0.688450
Epoch 6754
Loss = 2.4708e-02, PNorm = 743.8555, GNorm = 3.7974, lr_0 = 9.9536e-04
Validation auc = 0.683898
Epoch 6755
Loss = 1.2254e-02, PNorm = 743.8921, GNorm = 0.8633, lr_0 = 9.9536e-04
Validation auc = 0.680723
Epoch 6756
Loss = 2.4089e-02, PNorm = 743.9350, GNorm = 1.1639, lr_0 = 9.9535e-04
Validation auc = 0.686130
Epoch 6757
Loss = 3.9921e-02, PNorm = 744.0105, GNorm = 1.3419, lr_0 = 9.9535e-04
Validation auc = 0.687220
Epoch 6758
Loss = 5.3189e-02, PNorm = 744.0782, GNorm = 2.3131, lr_0 = 9.9535e-04
Validation auc = 0.688493
Epoch 6759
Loss = 3.0151e-02, PNorm = 744.1444, GNorm = 1.8905, lr_0 = 9.9535e-04
Loss = 5.9080e-02, PNorm = 744.2011, GNorm = 3.6480, lr_0 = 9.9535e-04
Validation auc = 0.691370
Epoch 6760
Loss = 7.3503e-02, PNorm = 744.2680, GNorm = 2.1875, lr_0 = 9.9535e-04
Validation auc = 0.692540
Epoch 6761
Loss = 5.8031e-02, PNorm = 744.3343, GNorm = 1.6893, lr_0 = 9.9535e-04
Validation auc = 0.695879
Epoch 6762
Loss = 5.7633e-02, PNorm = 744.3931, GNorm = 3.5164, lr_0 = 9.9535e-04
Validation auc = 0.692647
Epoch 6763
Loss = 4.9482e-02, PNorm = 744.4485, GNorm = 2.5998, lr_0 = 9.9535e-04
Validation auc = 0.694638
Epoch 6764
Loss = 5.5938e-02, PNorm = 744.5238, GNorm = 3.6459, lr_0 = 9.9535e-04
Validation auc = 0.679067
Epoch 6765
Loss = 7.3713e-02, PNorm = 744.6466, GNorm = 3.3926, lr_0 = 9.9535e-04
Validation auc = 0.672207
Epoch 6766
Loss = 8.2438e-02, PNorm = 744.7490, GNorm = 5.0445, lr_0 = 9.9535e-04
Validation auc = 0.680783
Epoch 6767
Loss = 6.2872e-02, PNorm = 744.8257, GNorm = 1.9750, lr_0 = 9.9535e-04
Validation auc = 0.690045
Epoch 6768
Loss = 1.6920e-02, PNorm = 744.8802, GNorm = 0.4962, lr_0 = 9.9535e-04
Validation auc = 0.691319
Epoch 6769
Loss = 5.3108e-02, PNorm = 744.9139, GNorm = 2.2438, lr_0 = 9.9534e-04
Loss = 6.3784e-02, PNorm = 744.9498, GNorm = 4.1478, lr_0 = 9.9534e-04
Validation auc = 0.686767
Epoch 6770
Loss = 4.4529e-02, PNorm = 744.9870, GNorm = 0.4258, lr_0 = 9.9534e-04
Validation auc = 0.687006
Epoch 6771
Loss = 3.4090e-02, PNorm = 745.0247, GNorm = 0.2898, lr_0 = 9.9534e-04
Validation auc = 0.692591
Epoch 6772
Loss = 3.6487e-02, PNorm = 745.0670, GNorm = 2.4070, lr_0 = 9.9534e-04
Validation auc = 0.699532
Epoch 6773
Loss = 1.7311e-02, PNorm = 745.1051, GNorm = 1.2798, lr_0 = 9.9534e-04
Validation auc = 0.701455
Epoch 6774
Loss = 3.0252e-02, PNorm = 745.1356, GNorm = 2.3438, lr_0 = 9.9534e-04
Validation auc = 0.699533
Epoch 6775
Loss = 4.2178e-02, PNorm = 745.1675, GNorm = 2.4175, lr_0 = 9.9534e-04
Validation auc = 0.700303
Epoch 6776
Loss = 1.0964e-02, PNorm = 745.1982, GNorm = 0.8782, lr_0 = 9.9534e-04
Validation auc = 0.701194
Epoch 6777
Loss = 5.2564e-02, PNorm = 745.2207, GNorm = 4.0704, lr_0 = 9.9534e-04
Validation auc = 0.696859
Epoch 6778
Loss = 6.7073e-02, PNorm = 745.2455, GNorm = 11.6916, lr_0 = 9.9534e-04
Validation auc = 0.695398
Epoch 6779
Loss = 2.1844e-03, PNorm = 745.2767, GNorm = 0.1564, lr_0 = 9.9534e-04
Loss = 9.5436e-03, PNorm = 745.3037, GNorm = 0.1034, lr_0 = 9.9534e-04
Validation auc = 0.698997
Epoch 6780
Loss = 3.0602e-02, PNorm = 745.3263, GNorm = 0.4283, lr_0 = 9.9534e-04
Validation auc = 0.702172
Epoch 6781
Loss = 3.7418e-02, PNorm = 745.3528, GNorm = 2.5922, lr_0 = 9.9534e-04
Validation auc = 0.700088
Epoch 6782
Loss = 6.0552e-02, PNorm = 745.3932, GNorm = 0.6212, lr_0 = 9.9533e-04
Validation auc = 0.691982
Epoch 6783
Loss = 3.7871e-02, PNorm = 745.4433, GNorm = 0.2206, lr_0 = 9.9533e-04
Validation auc = 0.689004
Epoch 6784
Loss = 3.1775e-02, PNorm = 745.4809, GNorm = 0.3803, lr_0 = 9.9533e-04
Validation auc = 0.686766
Epoch 6785
Loss = 3.4885e-02, PNorm = 745.5161, GNorm = 2.5592, lr_0 = 9.9533e-04
Validation auc = 0.677411
Epoch 6786
Loss = 1.9069e-02, PNorm = 745.5492, GNorm = 0.0328, lr_0 = 9.9533e-04
Validation auc = 0.677733
Epoch 6787
Loss = 1.4020e-02, PNorm = 745.5772, GNorm = 0.9363, lr_0 = 9.9533e-04
Validation auc = 0.680875
Epoch 6788
Loss = 2.0201e-02, PNorm = 745.6056, GNorm = 4.1996, lr_0 = 9.9533e-04
Validation auc = 0.689082
Epoch 6789
Loss = 1.5615e-01, PNorm = 745.6370, GNorm = 7.1882, lr_0 = 9.9533e-04
Loss = 4.2247e-02, PNorm = 745.6699, GNorm = 2.5045, lr_0 = 9.9533e-04
Validation auc = 0.692367
Epoch 6790
Loss = 3.1022e-02, PNorm = 745.7051, GNorm = 1.8355, lr_0 = 9.9533e-04
Validation auc = 0.692675
Epoch 6791
Loss = 2.4678e-02, PNorm = 745.7409, GNorm = 0.1536, lr_0 = 9.9533e-04
Validation auc = 0.698528
Epoch 6792
Loss = 1.1978e-01, PNorm = 745.7782, GNorm = 3.7328, lr_0 = 9.9533e-04
Validation auc = 0.698403
Epoch 6793
Loss = 6.7561e-02, PNorm = 745.8208, GNorm = 3.9111, lr_0 = 9.9533e-04
Validation auc = 0.696267
Epoch 6794
Loss = 4.1873e-02, PNorm = 745.8688, GNorm = 4.2328, lr_0 = 9.9533e-04
Validation auc = 0.705680
Epoch 6795
Loss = 9.3725e-03, PNorm = 745.9143, GNorm = 0.4388, lr_0 = 9.9532e-04
Validation auc = 0.705662
Epoch 6796
Loss = 1.9267e-02, PNorm = 745.9475, GNorm = 0.6848, lr_0 = 9.9532e-04
Validation auc = 0.703810
Epoch 6797
Loss = 1.0115e-02, PNorm = 745.9930, GNorm = 1.2523, lr_0 = 9.9532e-04
Validation auc = 0.707137
Epoch 6798
Loss = 4.3067e-02, PNorm = 746.0440, GNorm = 3.0616, lr_0 = 9.9532e-04
Validation auc = 0.710049
Epoch 6799
Loss = 1.4097e-02, PNorm = 746.0887, GNorm = 0.8454, lr_0 = 9.9532e-04
Loss = 9.5296e-02, PNorm = 746.1292, GNorm = 0.9798, lr_0 = 9.9532e-04
Validation auc = 0.697360
Epoch 6800
Loss = 1.4415e-01, PNorm = 746.1806, GNorm = 3.4532, lr_0 = 9.9532e-04
Validation auc = 0.688552
Epoch 6801
Loss = 4.7058e-02, PNorm = 746.2447, GNorm = 2.0402, lr_0 = 9.9532e-04
Validation auc = 0.689130
Epoch 6802
Loss = 4.4499e-02, PNorm = 746.2945, GNorm = 0.4790, lr_0 = 9.9532e-04
Validation auc = 0.688945
Epoch 6803
Loss = 2.8729e-02, PNorm = 746.3347, GNorm = 0.0344, lr_0 = 9.9532e-04
Validation auc = 0.691710
Epoch 6804
Loss = 4.5186e-02, PNorm = 746.3647, GNorm = 0.9149, lr_0 = 9.9532e-04
Validation auc = 0.692288
Epoch 6805
Loss = 2.9991e-02, PNorm = 746.4244, GNorm = 3.0848, lr_0 = 9.9532e-04
Validation auc = 0.696244
Epoch 6806
Loss = 6.9140e-02, PNorm = 746.4827, GNorm = 1.8151, lr_0 = 9.9532e-04
Validation auc = 0.698325
Epoch 6807
Loss = 3.5436e-02, PNorm = 746.5370, GNorm = 0.2722, lr_0 = 9.9532e-04
Validation auc = 0.699934
Epoch 6808
Loss = 1.4842e-01, PNorm = 746.6057, GNorm = 0.2633, lr_0 = 9.9532e-04
Validation auc = 0.696407
Epoch 6809
Loss = 3.5645e-02, PNorm = 746.7013, GNorm = 1.4726, lr_0 = 9.9531e-04
Loss = 1.4183e-01, PNorm = 746.7714, GNorm = 18.9670, lr_0 = 9.9531e-04
Validation auc = 0.696547
Epoch 6810
Loss = 5.8468e-02, PNorm = 746.8419, GNorm = 5.1942, lr_0 = 9.9531e-04
Validation auc = 0.693197
Epoch 6811
Loss = 7.3255e-02, PNorm = 746.8974, GNorm = 1.2167, lr_0 = 9.9531e-04
Validation auc = 0.692184
Epoch 6812
Loss = 5.1970e-02, PNorm = 746.9497, GNorm = 0.7326, lr_0 = 9.9531e-04
Validation auc = 0.696351
Epoch 6813
Loss = 7.7236e-02, PNorm = 747.0006, GNorm = 4.4082, lr_0 = 9.9531e-04
Validation auc = 0.696611
Epoch 6814
Loss = 3.8846e-01, PNorm = 747.0573, GNorm = 151.9243, lr_0 = 9.9531e-04
Validation auc = 0.714142
Epoch 6815
Loss = 1.0538e-01, PNorm = 747.1943, GNorm = 2.0489, lr_0 = 9.9531e-04
Validation auc = 0.705929
Epoch 6816
Loss = 2.5403e-01, PNorm = 747.3284, GNorm = 2.0907, lr_0 = 9.9531e-04
Validation auc = 0.706199
Epoch 6817
Loss = 4.5294e-02, PNorm = 747.5161, GNorm = 1.7029, lr_0 = 9.9531e-04
Validation auc = 0.706728
Epoch 6818
Loss = 5.0260e-02, PNorm = 747.6436, GNorm = 1.9189, lr_0 = 9.9531e-04
Validation auc = 0.714028
Epoch 6819
Loss = 1.5050e-01, PNorm = 747.7193, GNorm = 6.7710, lr_0 = 9.9531e-04
Loss = 1.2109e-01, PNorm = 747.7816, GNorm = 8.4652, lr_0 = 9.9531e-04
Validation auc = 0.704525
Epoch 6820
Loss = 9.2439e-02, PNorm = 747.8579, GNorm = 1.0553, lr_0 = 9.9531e-04
Validation auc = 0.688328
Epoch 6821
Loss = 6.7111e-02, PNorm = 747.9370, GNorm = 4.9582, lr_0 = 9.9531e-04
Validation auc = 0.684908
Epoch 6822
Loss = 5.8508e-02, PNorm = 748.0001, GNorm = 3.3043, lr_0 = 9.9530e-04
Validation auc = 0.690758
Epoch 6823
Loss = 4.9843e-02, PNorm = 748.0561, GNorm = 1.2571, lr_0 = 9.9530e-04
Validation auc = 0.698243
Epoch 6824
Loss = 5.3269e-02, PNorm = 748.1036, GNorm = 2.8736, lr_0 = 9.9530e-04
Validation auc = 0.696733
Epoch 6825
Loss = 8.3117e-02, PNorm = 748.1483, GNorm = 0.5321, lr_0 = 9.9530e-04
Validation auc = 0.703292
Epoch 6826
Loss = 8.6878e-02, PNorm = 748.1964, GNorm = 3.6753, lr_0 = 9.9530e-04
Validation auc = 0.707603
Epoch 6827
Loss = 5.0467e-02, PNorm = 748.2406, GNorm = 1.0185, lr_0 = 9.9530e-04
Validation auc = 0.706550
Epoch 6828
Loss = 6.7674e-02, PNorm = 748.2919, GNorm = 0.4190, lr_0 = 9.9530e-04
Validation auc = 0.700453
Epoch 6829
Loss = 1.8282e-02, PNorm = 748.3361, GNorm = 1.9202, lr_0 = 9.9530e-04
Loss = 1.7594e-01, PNorm = 748.4120, GNorm = 3.5176, lr_0 = 9.9530e-04
Validation auc = 0.703891
Epoch 6830
Loss = 1.5669e-01, PNorm = 748.5139, GNorm = 4.8391, lr_0 = 9.9530e-04
Validation auc = 0.709698
Epoch 6831
Loss = 1.7130e-01, PNorm = 748.6291, GNorm = 0.8445, lr_0 = 9.9530e-04
Validation auc = 0.704767
Epoch 6832
Loss = 1.2093e-01, PNorm = 748.7358, GNorm = 3.3834, lr_0 = 9.9530e-04
Validation auc = 0.699638
Epoch 6833
Loss = 1.1074e-01, PNorm = 748.8316, GNorm = 0.9100, lr_0 = 9.9530e-04
Validation auc = 0.700826
Epoch 6834
Loss = 3.5193e-02, PNorm = 748.9172, GNorm = 2.8765, lr_0 = 9.9530e-04
Validation auc = 0.702850
Epoch 6835
Loss = 3.9445e-02, PNorm = 748.9799, GNorm = 0.8377, lr_0 = 9.9529e-04
Validation auc = 0.701840
Epoch 6836
Loss = 4.9371e-02, PNorm = 749.0226, GNorm = 2.8315, lr_0 = 9.9529e-04
Validation auc = 0.699968
Epoch 6837
Loss = 1.0580e-01, PNorm = 749.0614, GNorm = 0.7048, lr_0 = 9.9529e-04
Validation auc = 0.693647
Epoch 6838
Loss = 1.4877e-01, PNorm = 749.1038, GNorm = 0.7849, lr_0 = 9.9529e-04
Validation auc = 0.689164
Epoch 6839
Loss = 1.4965e-02, PNorm = 749.1554, GNorm = 0.5793, lr_0 = 9.9529e-04
Loss = 1.7059e-02, PNorm = 749.1950, GNorm = 0.4445, lr_0 = 9.9529e-04
Validation auc = 0.690116
Epoch 6840
Loss = 9.5976e-02, PNorm = 749.2315, GNorm = 0.9785, lr_0 = 9.9529e-04
Validation auc = 0.695934
Epoch 6841
Loss = 3.2259e-02, PNorm = 749.2689, GNorm = 0.6111, lr_0 = 9.9529e-04
Validation auc = 0.701006
Epoch 6842
Loss = 9.9386e-02, PNorm = 749.3074, GNorm = 0.9142, lr_0 = 9.9529e-04
Validation auc = 0.700964
Epoch 6843
Loss = 3.4559e-02, PNorm = 749.3587, GNorm = 2.5156, lr_0 = 9.9529e-04
Validation auc = 0.698696
Epoch 6844
Loss = 3.3890e-02, PNorm = 749.3991, GNorm = 0.6933, lr_0 = 9.9529e-04
Validation auc = 0.699207
Epoch 6845
Loss = 8.2308e-02, PNorm = 749.4349, GNorm = 1.5289, lr_0 = 9.9529e-04
Validation auc = 0.699853
Epoch 6846
Loss = 1.2616e-01, PNorm = 749.4691, GNorm = 2.2532, lr_0 = 9.9529e-04
Validation auc = 0.699241
Epoch 6847
Loss = 4.1223e-02, PNorm = 749.5018, GNorm = 1.4480, lr_0 = 9.9529e-04
Validation auc = 0.706054
Epoch 6848
Loss = 1.9801e-02, PNorm = 749.5327, GNorm = 0.4145, lr_0 = 9.9529e-04
Validation auc = 0.705169
Epoch 6849
Loss = 5.2109e-03, PNorm = 749.5630, GNorm = 0.4886, lr_0 = 9.9528e-04
Loss = 3.6065e-02, PNorm = 749.5965, GNorm = 0.7888, lr_0 = 9.9528e-04
Validation auc = 0.706548
Epoch 6850
Loss = 9.4985e-02, PNorm = 749.6315, GNorm = 5.9597, lr_0 = 9.9528e-04
Validation auc = 0.705678
Epoch 6851
Loss = 3.3200e-02, PNorm = 749.6741, GNorm = 0.7485, lr_0 = 9.9528e-04
Validation auc = 0.703457
Epoch 6852
Loss = 6.0937e-02, PNorm = 749.7171, GNorm = 1.2000, lr_0 = 9.9528e-04
Validation auc = 0.696309
Epoch 6853
Loss = 1.0195e-01, PNorm = 749.7736, GNorm = 0.9079, lr_0 = 9.9528e-04
Validation auc = 0.689044
Epoch 6854
Loss = 4.3424e-02, PNorm = 749.8478, GNorm = 3.2731, lr_0 = 9.9528e-04
Validation auc = 0.688318
Epoch 6855
Loss = 1.8756e-02, PNorm = 749.9057, GNorm = 1.0768, lr_0 = 9.9528e-04
Validation auc = 0.695539
Epoch 6856
Loss = 5.6955e-02, PNorm = 749.9616, GNorm = 0.8632, lr_0 = 9.9528e-04
Validation auc = 0.702058
Epoch 6857
Loss = 1.9643e-02, PNorm = 750.0131, GNorm = 2.2231, lr_0 = 9.9528e-04
Validation auc = 0.705097
Epoch 6858
Loss = 3.8409e-02, PNorm = 750.0583, GNorm = 3.4810, lr_0 = 9.9528e-04
Validation auc = 0.709623
Epoch 6859
Loss = 1.1015e-01, PNorm = 750.1065, GNorm = 2.8246, lr_0 = 9.9528e-04
Loss = 8.4738e-02, PNorm = 750.1596, GNorm = 0.2175, lr_0 = 9.9528e-04
Validation auc = 0.704280
Epoch 6860
Loss = 7.5403e-02, PNorm = 750.2117, GNorm = 2.8259, lr_0 = 9.9528e-04
Validation auc = 0.706311
Epoch 6861
Loss = 5.5081e-02, PNorm = 750.2782, GNorm = 0.6849, lr_0 = 9.9527e-04
Validation auc = 0.703564
Epoch 6862
Loss = 7.7637e-02, PNorm = 750.3269, GNorm = 2.1063, lr_0 = 9.9527e-04
Validation auc = 0.700834
Epoch 6863
Loss = 4.1102e-02, PNorm = 750.3736, GNorm = 0.4315, lr_0 = 9.9527e-04
Validation auc = 0.697293
Epoch 6864
Loss = 7.9204e-02, PNorm = 750.4092, GNorm = 2.2778, lr_0 = 9.9527e-04
Validation auc = 0.696704
Epoch 6865
Loss = 9.3344e-02, PNorm = 750.4455, GNorm = 2.2220, lr_0 = 9.9527e-04
Validation auc = 0.695270
Epoch 6866
Loss = 2.8598e-02, PNorm = 750.4906, GNorm = 0.5505, lr_0 = 9.9527e-04
Validation auc = 0.693759
Epoch 6867
Loss = 1.0941e-01, PNorm = 750.5284, GNorm = 0.4324, lr_0 = 9.9527e-04
Validation auc = 0.692009
Epoch 6868
Loss = 1.7382e-01, PNorm = 750.5650, GNorm = 6.8748, lr_0 = 9.9527e-04
Validation auc = 0.692362
Epoch 6869
Loss = 5.1266e-02, PNorm = 750.6033, GNorm = 2.4617, lr_0 = 9.9527e-04
Loss = 2.8012e-02, PNorm = 750.6391, GNorm = 0.6207, lr_0 = 9.9527e-04
Validation auc = 0.697806
Epoch 6870
Loss = 5.3765e-02, PNorm = 750.6692, GNorm = 0.7500, lr_0 = 9.9527e-04
Validation auc = 0.702052
Epoch 6871
Loss = 2.7898e-02, PNorm = 750.7007, GNorm = 0.4071, lr_0 = 9.9527e-04
Validation auc = 0.705308
Epoch 6872
Loss = 1.1765e-01, PNorm = 750.7346, GNorm = 0.3888, lr_0 = 9.9527e-04
Validation auc = 0.696808
Epoch 6873
Loss = 2.3073e-02, PNorm = 750.7684, GNorm = 0.5911, lr_0 = 9.9527e-04
Validation auc = 0.698255
Epoch 6874
Loss = 7.3529e-02, PNorm = 750.7977, GNorm = 0.6701, lr_0 = 9.9527e-04
Validation auc = 0.697760
Epoch 6875
Loss = 4.3056e-02, PNorm = 750.8236, GNorm = 1.7836, lr_0 = 9.9526e-04
Validation auc = 0.695594
Epoch 6876
Loss = 3.5655e-02, PNorm = 750.8558, GNorm = 2.5178, lr_0 = 9.9526e-04
Validation auc = 0.691244
Epoch 6877
Loss = 8.2157e-02, PNorm = 750.8902, GNorm = 1.5363, lr_0 = 9.9526e-04
Validation auc = 0.685635
Epoch 6878
Loss = 3.4477e-02, PNorm = 750.9267, GNorm = 1.8646, lr_0 = 9.9526e-04
Validation auc = 0.690866
Epoch 6879
Loss = 6.0606e-03, PNorm = 750.9644, GNorm = 0.4451, lr_0 = 9.9526e-04
Loss = 6.6058e-02, PNorm = 751.0074, GNorm = 0.2881, lr_0 = 9.9526e-04
Validation auc = 0.697747
Epoch 6880
Loss = 4.7139e-02, PNorm = 751.0417, GNorm = 3.3503, lr_0 = 9.9526e-04
Validation auc = 0.697300
Epoch 6881
Loss = 3.3648e-02, PNorm = 751.0766, GNorm = 0.3121, lr_0 = 9.9526e-04
Validation auc = 0.695466
Epoch 6882
Loss = 2.3852e-02, PNorm = 751.1078, GNorm = 4.5555, lr_0 = 9.9526e-04
Validation auc = 0.693221
Epoch 6883
Loss = 2.9859e-02, PNorm = 751.1325, GNorm = 1.3029, lr_0 = 9.9526e-04
Validation auc = 0.691478
Epoch 6884
Loss = 8.8940e-02, PNorm = 751.1567, GNorm = 5.3799, lr_0 = 9.9526e-04
Validation auc = 0.690958
Epoch 6885
Loss = 3.3421e-02, PNorm = 751.1841, GNorm = 1.9126, lr_0 = 9.9526e-04
Validation auc = 0.691944
Epoch 6886
Loss = 8.0278e-02, PNorm = 751.2168, GNorm = 1.2128, lr_0 = 9.9526e-04
Validation auc = 0.692346
Epoch 6887
Loss = 4.4966e-03, PNorm = 751.2522, GNorm = 0.2793, lr_0 = 9.9526e-04
Validation auc = 0.687997
Epoch 6888
Loss = 9.2547e-03, PNorm = 751.2773, GNorm = 1.0793, lr_0 = 9.9526e-04
Validation auc = 0.687543
Epoch 6889
Loss = 4.4195e-02, PNorm = 751.2966, GNorm = 2.5007, lr_0 = 9.9525e-04
Loss = 5.9024e-02, PNorm = 751.3153, GNorm = 0.9061, lr_0 = 9.9525e-04
Validation auc = 0.690234
Epoch 6890
Loss = 4.0017e-02, PNorm = 751.3347, GNorm = 1.4929, lr_0 = 9.9525e-04
Validation auc = 0.687050
Epoch 6891
Loss = 7.6609e-02, PNorm = 751.3611, GNorm = 20.6446, lr_0 = 9.9525e-04
Validation auc = 0.678760
Epoch 6892
Loss = 3.3471e-02, PNorm = 751.4188, GNorm = 0.8571, lr_0 = 9.9525e-04
Validation auc = 0.672045
Epoch 6893
Loss = 2.0708e-02, PNorm = 751.4681, GNorm = 1.2093, lr_0 = 9.9525e-04
Validation auc = 0.670725
Epoch 6894
Loss = 5.5370e-02, PNorm = 751.5037, GNorm = 3.4169, lr_0 = 9.9525e-04
Validation auc = 0.670033
Epoch 6895
Loss = 4.1397e-02, PNorm = 751.5398, GNorm = 2.7696, lr_0 = 9.9525e-04
Validation auc = 0.672406
Epoch 6896
Loss = 1.7871e-02, PNorm = 751.5745, GNorm = 0.4203, lr_0 = 9.9525e-04
Validation auc = 0.673776
Epoch 6897
Loss = 4.7530e-02, PNorm = 751.6042, GNorm = 2.1084, lr_0 = 9.9525e-04
Validation auc = 0.677652
Epoch 6898
Loss = 1.1037e-02, PNorm = 751.6358, GNorm = 0.3018, lr_0 = 9.9525e-04
Validation auc = 0.682270
Epoch 6899
Loss = 2.5550e-02, PNorm = 751.6631, GNorm = 2.9107, lr_0 = 9.9525e-04
Loss = 2.7394e-02, PNorm = 751.6844, GNorm = 0.5148, lr_0 = 9.9525e-04
Validation auc = 0.680999
Epoch 6900
Loss = 4.7532e-02, PNorm = 751.7092, GNorm = 0.5691, lr_0 = 9.9525e-04
Validation auc = 0.680897
Epoch 6901
Loss = 2.0239e-02, PNorm = 751.7402, GNorm = 1.3826, lr_0 = 9.9524e-04
Validation auc = 0.677333
Epoch 6902
Loss = 3.0439e-02, PNorm = 751.7706, GNorm = 4.3493, lr_0 = 9.9524e-04
Validation auc = 0.675374
Epoch 6903
Loss = 1.3821e-02, PNorm = 751.8008, GNorm = 0.4755, lr_0 = 9.9524e-04
Validation auc = 0.677193
Epoch 6904
Loss = 5.0248e-02, PNorm = 751.8274, GNorm = 2.1666, lr_0 = 9.9524e-04
Validation auc = 0.684475
Epoch 6905
Loss = 9.1117e-02, PNorm = 751.8699, GNorm = 1.4286, lr_0 = 9.9524e-04
Validation auc = 0.686745
Epoch 6906
Loss = 2.2176e-02, PNorm = 751.9185, GNorm = 1.0723, lr_0 = 9.9524e-04
Validation auc = 0.687549
Epoch 6907
Loss = 4.8403e-02, PNorm = 751.9597, GNorm = 0.8161, lr_0 = 9.9524e-04
Validation auc = 0.696797
Epoch 6908
Loss = 7.2575e-02, PNorm = 752.0073, GNorm = 4.6970, lr_0 = 9.9524e-04
Validation auc = 0.705076
Epoch 6909
Loss = 1.0883e-02, PNorm = 752.0542, GNorm = 0.5500, lr_0 = 9.9524e-04
Loss = 1.0592e-01, PNorm = 752.1087, GNorm = 4.0851, lr_0 = 9.9524e-04
Validation auc = 0.704374
Epoch 6910
Loss = 3.8446e-02, PNorm = 752.1656, GNorm = 2.9584, lr_0 = 9.9524e-04
Validation auc = 0.703301
Epoch 6911
Loss = 7.0124e-02, PNorm = 752.2148, GNorm = 5.4725, lr_0 = 9.9524e-04
Validation auc = 0.697647
Epoch 6912
Loss = 2.3950e-01, PNorm = 752.2656, GNorm = 38.1944, lr_0 = 9.9524e-04
Validation auc = 0.693042
Epoch 6913
Loss = 8.4262e-02, PNorm = 752.3260, GNorm = 2.5596, lr_0 = 9.9524e-04
Validation auc = 0.693442
Epoch 6914
Loss = 7.5096e-02, PNorm = 752.3896, GNorm = 2.0645, lr_0 = 9.9524e-04
Validation auc = 0.700964
Epoch 6915
Loss = 6.8832e-02, PNorm = 752.4500, GNorm = 0.8977, lr_0 = 9.9523e-04
Validation auc = 0.703196
Epoch 6916
Loss = 8.5367e-02, PNorm = 752.5017, GNorm = 4.4521, lr_0 = 9.9523e-04
Validation auc = 0.701749
Epoch 6917
Loss = 9.0662e-02, PNorm = 752.5427, GNorm = 4.8244, lr_0 = 9.9523e-04
Validation auc = 0.693735
Epoch 6918
Loss = 5.4367e-02, PNorm = 752.5889, GNorm = 2.8755, lr_0 = 9.9523e-04
Validation auc = 0.688478
Epoch 6919
Loss = 5.2285e-02, PNorm = 752.6286, GNorm = 1.7233, lr_0 = 9.9523e-04
Loss = 3.5368e-02, PNorm = 752.6609, GNorm = 0.7317, lr_0 = 9.9523e-04
Validation auc = 0.681951
Epoch 6920
Loss = 4.5738e-02, PNorm = 752.6973, GNorm = 0.8090, lr_0 = 9.9523e-04
Validation auc = 0.674904
Epoch 6921
Loss = 4.9100e-02, PNorm = 752.7326, GNorm = 0.3419, lr_0 = 9.9523e-04
Validation auc = 0.672586
Epoch 6922
Loss = 4.0558e-02, PNorm = 752.7687, GNorm = 6.3664, lr_0 = 9.9523e-04
Validation auc = 0.675453
Epoch 6923
Loss = 2.8046e-02, PNorm = 752.7992, GNorm = 0.5878, lr_0 = 9.9523e-04
Validation auc = 0.683558
Epoch 6924
Loss = 3.7763e-02, PNorm = 752.8312, GNorm = 1.8233, lr_0 = 9.9523e-04
Validation auc = 0.682584
Epoch 6925
Loss = 1.3850e-01, PNorm = 752.8753, GNorm = 3.0670, lr_0 = 9.9523e-04
Validation auc = 0.693064
Epoch 6926
Loss = 7.7596e-02, PNorm = 752.9309, GNorm = 0.2336, lr_0 = 9.9523e-04
Validation auc = 0.691152
Epoch 6927
Loss = 7.0559e-02, PNorm = 752.9770, GNorm = 7.2028, lr_0 = 9.9523e-04
Validation auc = 0.695029
Epoch 6928
Loss = 5.6795e-02, PNorm = 753.0235, GNorm = 3.2695, lr_0 = 9.9522e-04
Validation auc = 0.703929
Epoch 6929
Loss = 2.3509e-02, PNorm = 753.0702, GNorm = 1.2847, lr_0 = 9.9522e-04
Loss = 5.6770e-02, PNorm = 753.1183, GNorm = 2.0607, lr_0 = 9.9522e-04
Validation auc = 0.709712
Epoch 6930
Loss = 6.6932e-02, PNorm = 753.1742, GNorm = 0.3129, lr_0 = 9.9522e-04
Validation auc = 0.710563
Epoch 6931
Loss = 2.8740e-02, PNorm = 753.2590, GNorm = 0.7520, lr_0 = 9.9522e-04
Validation auc = 0.711099
Epoch 6932
Loss = 8.1365e-02, PNorm = 753.3171, GNorm = 4.1751, lr_0 = 9.9522e-04
Validation auc = 0.709773
Epoch 6933
Loss = 9.0337e-02, PNorm = 753.3795, GNorm = 2.2493, lr_0 = 9.9522e-04
Validation auc = 0.708893
Epoch 6934
Loss = 1.0762e-01, PNorm = 753.4481, GNorm = 2.0725, lr_0 = 9.9522e-04
Validation auc = 0.708127
Epoch 6935
Loss = 1.6758e-01, PNorm = 753.5101, GNorm = 9.5173, lr_0 = 9.9522e-04
Validation auc = 0.716976
Epoch 6936
Loss = 1.1898e-01, PNorm = 753.5737, GNorm = 0.9682, lr_0 = 9.9522e-04
Validation auc = 0.724379
Epoch 6937
Loss = 4.3166e-02, PNorm = 753.6455, GNorm = 1.4623, lr_0 = 9.9522e-04
Validation auc = 0.725108
Epoch 6938
Loss = 2.4701e-02, PNorm = 753.7044, GNorm = 1.4761, lr_0 = 9.9522e-04
Validation auc = 0.722977
Epoch 6939
Loss = 7.7897e-02, PNorm = 753.7528, GNorm = 4.4164, lr_0 = 9.9522e-04
Loss = 8.5422e-02, PNorm = 753.7933, GNorm = 5.6839, lr_0 = 9.9522e-04
Validation auc = 0.723687
Epoch 6940
Loss = 4.9529e-02, PNorm = 753.8368, GNorm = 1.5452, lr_0 = 9.9522e-04
Validation auc = 0.725278
Epoch 6941
Loss = 5.0689e-02, PNorm = 753.8901, GNorm = 2.0024, lr_0 = 9.9521e-04
Validation auc = 0.727640
Epoch 6942
Loss = 4.6970e-02, PNorm = 753.9390, GNorm = 2.4010, lr_0 = 9.9521e-04
Validation auc = 0.723939
Epoch 6943
Loss = 9.8964e-02, PNorm = 753.9884, GNorm = 2.1358, lr_0 = 9.9521e-04
Validation auc = 0.717928
Epoch 6944
Loss = 5.3971e-02, PNorm = 754.0393, GNorm = 0.8967, lr_0 = 9.9521e-04
Validation auc = 0.716165
Epoch 6945
Loss = 4.2464e-02, PNorm = 754.0857, GNorm = 2.0101, lr_0 = 9.9521e-04
Validation auc = 0.717071
Epoch 6946
Loss = 3.6370e-02, PNorm = 754.1398, GNorm = 1.7121, lr_0 = 9.9521e-04
Validation auc = 0.721647
Epoch 6947
Loss = 1.0548e-02, PNorm = 754.1888, GNorm = 1.0908, lr_0 = 9.9521e-04
Validation auc = 0.724334
Epoch 6948
Loss = 3.7533e-02, PNorm = 754.2225, GNorm = 1.7414, lr_0 = 9.9521e-04
Validation auc = 0.721090
Epoch 6949
Loss = 3.8422e-02, PNorm = 754.2667, GNorm = 11.4674, lr_0 = 9.9521e-04
Loss = 4.1353e-02, PNorm = 754.3335, GNorm = 0.8660, lr_0 = 9.9521e-04
Validation auc = 0.716597
Epoch 6950
Loss = 4.3053e-02, PNorm = 754.3837, GNorm = 9.0200, lr_0 = 9.9521e-04
Validation auc = 0.715522
Epoch 6951
Loss = 3.8312e-02, PNorm = 754.4306, GNorm = 2.1415, lr_0 = 9.9521e-04
Validation auc = 0.712118
Epoch 6952
Loss = 3.6255e-02, PNorm = 754.4771, GNorm = 7.0362, lr_0 = 9.9521e-04
Validation auc = 0.713153
Epoch 6953
Loss = 1.6555e-01, PNorm = 754.5424, GNorm = 3.6106, lr_0 = 9.9521e-04
Validation auc = 0.707125
Epoch 6954
Loss = 8.3608e-02, PNorm = 754.6281, GNorm = 1.0056, lr_0 = 9.9521e-04
Validation auc = 0.710141
Epoch 6955
Loss = 5.1553e-02, PNorm = 754.6971, GNorm = 1.2955, lr_0 = 9.9520e-04
Validation auc = 0.708979
Epoch 6956
Loss = 6.3328e-02, PNorm = 754.7533, GNorm = 0.4978, lr_0 = 9.9520e-04
Validation auc = 0.716569
Epoch 6957
Loss = 6.6199e-02, PNorm = 754.8042, GNorm = 0.2557, lr_0 = 9.9520e-04
Validation auc = 0.720181
Epoch 6958
Loss = 1.8773e-02, PNorm = 754.8557, GNorm = 0.3852, lr_0 = 9.9520e-04
Validation auc = 0.721987
Epoch 6959
Loss = 2.4091e-02, PNorm = 754.9084, GNorm = 2.6412, lr_0 = 9.9520e-04
Loss = 4.5716e-02, PNorm = 754.9574, GNorm = 1.0495, lr_0 = 9.9520e-04
Validation auc = 0.719728
Epoch 6960
Loss = 4.0167e-02, PNorm = 755.0044, GNorm = 0.5537, lr_0 = 9.9520e-04
Validation auc = 0.720731
Epoch 6961
Loss = 3.5630e-02, PNorm = 755.0564, GNorm = 0.3061, lr_0 = 9.9520e-04
Validation auc = 0.720202
Epoch 6962
Loss = 6.3542e-02, PNorm = 755.1100, GNorm = 2.1928, lr_0 = 9.9520e-04
Validation auc = 0.717729
Epoch 6963
Loss = 1.2831e-02, PNorm = 755.1526, GNorm = 0.5269, lr_0 = 9.9520e-04
Validation auc = 0.715659
Epoch 6964
Loss = 4.6026e-02, PNorm = 755.1823, GNorm = 1.0726, lr_0 = 9.9520e-04
Validation auc = 0.715928
Epoch 6965
Loss = 4.6030e-02, PNorm = 755.2097, GNorm = 0.9408, lr_0 = 9.9520e-04
Validation auc = 0.720413
Epoch 6966
Loss = 8.7386e-02, PNorm = 755.2345, GNorm = 9.2262, lr_0 = 9.9520e-04
Validation auc = 0.716768
Epoch 6967
Loss = 9.1161e-03, PNorm = 755.2579, GNorm = 0.5454, lr_0 = 9.9520e-04
Validation auc = 0.717070
Epoch 6968
Loss = 1.7755e-02, PNorm = 755.2896, GNorm = 3.3907, lr_0 = 9.9519e-04
Validation auc = 0.721300
Epoch 6969
Loss = 1.4223e-02, PNorm = 755.3266, GNorm = 0.8199, lr_0 = 9.9519e-04
Loss = 6.4622e-02, PNorm = 755.3581, GNorm = 6.0721, lr_0 = 9.9519e-04
Validation auc = 0.720495
Epoch 6970
Loss = 7.7945e-02, PNorm = 755.3989, GNorm = 0.6240, lr_0 = 9.9519e-04
Validation auc = 0.719113
Epoch 6971
Loss = 1.8425e-02, PNorm = 755.4382, GNorm = 3.4133, lr_0 = 9.9519e-04
Validation auc = 0.721101
Epoch 6972
Loss = 3.2186e-02, PNorm = 755.4720, GNorm = 0.4977, lr_0 = 9.9519e-04
Validation auc = 0.725809
Epoch 6973
Loss = 1.1953e-01, PNorm = 755.5061, GNorm = 3.3760, lr_0 = 9.9519e-04
Validation auc = 0.716677
Epoch 6974
Loss = 4.6117e-02, PNorm = 755.5513, GNorm = 0.5232, lr_0 = 9.9519e-04
Validation auc = 0.714127
Epoch 6975
Loss = 6.4903e-02, PNorm = 755.5898, GNorm = 0.2352, lr_0 = 9.9519e-04
Validation auc = 0.710240
Epoch 6976
Loss = 5.2818e-02, PNorm = 755.6276, GNorm = 0.2288, lr_0 = 9.9519e-04
Validation auc = 0.701229
Epoch 6977
Loss = 2.7431e-02, PNorm = 755.6683, GNorm = 0.4971, lr_0 = 9.9519e-04
Validation auc = 0.699582
Epoch 6978
Loss = 3.7559e-02, PNorm = 755.7120, GNorm = 2.9845, lr_0 = 9.9519e-04
Validation auc = 0.703217
Epoch 6979
Loss = 5.9363e-03, PNorm = 755.7482, GNorm = 0.3607, lr_0 = 9.9519e-04
Loss = 3.4421e-02, PNorm = 755.7806, GNorm = 0.5115, lr_0 = 9.9519e-04
Validation auc = 0.706359
Epoch 6980
Loss = 9.3025e-02, PNorm = 755.8307, GNorm = 0.6079, lr_0 = 9.9519e-04
Validation auc = 0.705868
Epoch 6981
Loss = 4.6394e-02, PNorm = 755.8976, GNorm = 1.6519, lr_0 = 9.9518e-04
Validation auc = 0.706147
Epoch 6982
Loss = 6.2836e-02, PNorm = 755.9522, GNorm = 0.3329, lr_0 = 9.9518e-04
Validation auc = 0.710208
Epoch 6983
Loss = 7.3479e-02, PNorm = 756.0099, GNorm = 0.4525, lr_0 = 9.9518e-04
Validation auc = 0.707545
Epoch 6984
Loss = 2.2261e-02, PNorm = 756.0571, GNorm = 0.7098, lr_0 = 9.9518e-04
Validation auc = 0.705337
Epoch 6985
Loss = 3.8338e-02, PNorm = 756.0952, GNorm = 1.2922, lr_0 = 9.9518e-04
Validation auc = 0.706424
Epoch 6986
Loss = 2.1425e-02, PNorm = 756.1296, GNorm = 0.5989, lr_0 = 9.9518e-04
Validation auc = 0.705768
Epoch 6987
Loss = 3.8332e-02, PNorm = 756.1634, GNorm = 1.2011, lr_0 = 9.9518e-04
Validation auc = 0.700837
Epoch 6988
Loss = 4.4292e-02, PNorm = 756.2119, GNorm = 2.4010, lr_0 = 9.9518e-04
Validation auc = 0.696169
Epoch 6989
Loss = 3.6523e-01, PNorm = 756.2732, GNorm = 17.5496, lr_0 = 9.9518e-04
Loss = 7.3883e-02, PNorm = 756.3369, GNorm = 1.6235, lr_0 = 9.9518e-04
Validation auc = 0.692402
Epoch 6990
Loss = 3.1205e-02, PNorm = 756.3951, GNorm = 2.0727, lr_0 = 9.9518e-04
Validation auc = 0.691418
Epoch 6991
Loss = 5.3796e-02, PNorm = 756.4615, GNorm = 0.9713, lr_0 = 9.9518e-04
Validation auc = 0.699116
Epoch 6992
Loss = 5.2987e-02, PNorm = 756.5120, GNorm = 5.3038, lr_0 = 9.9518e-04
Validation auc = 0.701973
Epoch 6993
Loss = 7.9055e-02, PNorm = 756.5534, GNorm = 3.2407, lr_0 = 9.9518e-04
Validation auc = 0.699191
Epoch 6994
Loss = 4.7761e-02, PNorm = 756.5937, GNorm = 0.8193, lr_0 = 9.9517e-04
Validation auc = 0.694983
Epoch 6995
Loss = 5.7819e-02, PNorm = 756.6290, GNorm = 0.9935, lr_0 = 9.9517e-04
Validation auc = 0.696494
Epoch 6996
Loss = 1.1036e-01, PNorm = 756.6573, GNorm = 2.2899, lr_0 = 9.9517e-04
Validation auc = 0.703298
Epoch 6997
Loss = 1.3621e-02, PNorm = 756.6896, GNorm = 0.2896, lr_0 = 9.9517e-04
Validation auc = 0.705080
Epoch 6998
Loss = 6.6235e-03, PNorm = 756.7193, GNorm = 0.4852, lr_0 = 9.9517e-04
Validation auc = 0.708549
Epoch 6999
Loss = 9.3462e-03, PNorm = 756.7460, GNorm = 0.5578, lr_0 = 9.9517e-04
Loss = 1.9639e-02, PNorm = 756.7697, GNorm = 0.3086, lr_0 = 9.9517e-04
Validation auc = 0.711206
Epoch 7000
Loss = 5.4999e-01, PNorm = 756.8696, GNorm = 2.2082, lr_0 = 9.9517e-04
Validation auc = 0.710947
Epoch 7001
Loss = 8.6878e-02, PNorm = 756.9590, GNorm = 2.1054, lr_0 = 9.9517e-04
Validation auc = 0.715420
Epoch 7002
Loss = 1.2315e-01, PNorm = 757.0305, GNorm = 1.7159, lr_0 = 9.9517e-04
Validation auc = 0.715036
Epoch 7003
Loss = 7.3166e-02, PNorm = 757.0990, GNorm = 1.6754, lr_0 = 9.9517e-04
Validation auc = 0.711795
Epoch 7004
Loss = 1.2411e-01, PNorm = 757.1550, GNorm = 4.6371, lr_0 = 9.9517e-04
Validation auc = 0.711102
Epoch 7005
Loss = 8.4562e-02, PNorm = 757.2002, GNorm = 1.1426, lr_0 = 9.9517e-04
Validation auc = 0.709495
Epoch 7006
Loss = 7.5691e-02, PNorm = 757.2464, GNorm = 1.2946, lr_0 = 9.9517e-04
Validation auc = 0.700451
Epoch 7007
Loss = 6.6774e-02, PNorm = 757.2905, GNorm = 2.8419, lr_0 = 9.9517e-04
Validation auc = 0.701055
Epoch 7008
Loss = 1.1713e-01, PNorm = 757.3401, GNorm = 4.5369, lr_0 = 9.9516e-04
Validation auc = 0.709350
Epoch 7009
Loss = 2.7647e-02, PNorm = 757.3977, GNorm = 6.0780, lr_0 = 9.9516e-04
Loss = 3.6879e-02, PNorm = 757.4664, GNorm = 1.2347, lr_0 = 9.9516e-04
Validation auc = 0.717388
Epoch 7010
Loss = 9.8286e-02, PNorm = 757.5270, GNorm = 3.2279, lr_0 = 9.9516e-04
Validation auc = 0.720642
Epoch 7011
Loss = 6.9877e-02, PNorm = 757.5865, GNorm = 3.0080, lr_0 = 9.9516e-04
Validation auc = 0.724792
Epoch 7012
Loss = 7.8455e-02, PNorm = 757.6489, GNorm = 2.0704, lr_0 = 9.9516e-04
Validation auc = 0.734624
Epoch 7013
Loss = 3.4777e-02, PNorm = 757.7056, GNorm = 5.3150, lr_0 = 9.9516e-04
Validation auc = 0.733603
Epoch 7014
Loss = 1.4290e-01, PNorm = 757.7520, GNorm = 7.7182, lr_0 = 9.9516e-04
Validation auc = 0.734458
Epoch 7015
Loss = 3.8532e-02, PNorm = 757.8045, GNorm = 0.9239, lr_0 = 9.9516e-04
Validation auc = 0.737929
Epoch 7016
Loss = 1.4002e-01, PNorm = 757.8559, GNorm = 2.9669, lr_0 = 9.9516e-04
Validation auc = 0.733364
Epoch 7017
Loss = 2.1158e-02, PNorm = 757.9030, GNorm = 1.2275, lr_0 = 9.9516e-04
Validation auc = 0.728116
Epoch 7018
Loss = 2.8467e-02, PNorm = 757.9511, GNorm = 2.7572, lr_0 = 9.9516e-04
Validation auc = 0.727019
Epoch 7019
Loss = 3.3347e-02, PNorm = 758.0010, GNorm = 1.4679, lr_0 = 9.9516e-04
Loss = 2.5469e-02, PNorm = 758.0421, GNorm = 1.2473, lr_0 = 9.9516e-04
Validation auc = 0.725180
Epoch 7020
Loss = 9.2127e-02, PNorm = 758.0742, GNorm = 5.7002, lr_0 = 9.9515e-04
Validation auc = 0.721606
Epoch 7021
Loss = 6.6932e-02, PNorm = 758.1100, GNorm = 0.8661, lr_0 = 9.9515e-04
Validation auc = 0.714459
Epoch 7022
Loss = 5.9886e-02, PNorm = 758.1542, GNorm = 3.7674, lr_0 = 9.9515e-04
Validation auc = 0.708531
Epoch 7023
Loss = 6.5703e-02, PNorm = 758.1968, GNorm = 1.6049, lr_0 = 9.9515e-04
Validation auc = 0.707812
Epoch 7024
Loss = 2.3462e-02, PNorm = 758.2337, GNorm = 0.7067, lr_0 = 9.9515e-04
Validation auc = 0.708464
Epoch 7025
Loss = 2.0977e-02, PNorm = 758.2627, GNorm = 2.0666, lr_0 = 9.9515e-04
Validation auc = 0.706326
Epoch 7026
Loss = 7.2736e-02, PNorm = 758.2967, GNorm = 0.5981, lr_0 = 9.9515e-04
Validation auc = 0.698274
Epoch 7027
Loss = 3.5692e-02, PNorm = 758.3384, GNorm = 1.7843, lr_0 = 9.9515e-04
Validation auc = 0.700746
Epoch 7028
Loss = 5.2696e-03, PNorm = 758.3790, GNorm = 0.4286, lr_0 = 9.9515e-04
Validation auc = 0.702357
Epoch 7029
Loss = 2.1134e-03, PNorm = 758.4069, GNorm = 0.1644, lr_0 = 9.9515e-04
Loss = 2.5355e-02, PNorm = 758.4283, GNorm = 1.1227, lr_0 = 9.9515e-04
Validation auc = 0.704281
Epoch 7030
Loss = 3.4017e-02, PNorm = 758.4531, GNorm = 3.4288, lr_0 = 9.9515e-04
Validation auc = 0.703626
Epoch 7031
Loss = 6.0201e-02, PNorm = 758.4825, GNorm = 0.1050, lr_0 = 9.9515e-04
Validation auc = 0.702760
Epoch 7032
Loss = 2.5738e-02, PNorm = 758.5179, GNorm = 1.5118, lr_0 = 9.9515e-04
Validation auc = 0.700620
Epoch 7033
Loss = 3.5013e-02, PNorm = 758.5519, GNorm = 2.6880, lr_0 = 9.9515e-04
Validation auc = 0.699160
Epoch 7034
Loss = 6.0118e-02, PNorm = 758.5825, GNorm = 4.0603, lr_0 = 9.9514e-04
Validation auc = 0.701365
Epoch 7035
Loss = 7.2835e-02, PNorm = 758.6108, GNorm = 1.7251, lr_0 = 9.9514e-04
Validation auc = 0.700987
Epoch 7036
Loss = 1.9949e-02, PNorm = 758.6376, GNorm = 0.9651, lr_0 = 9.9514e-04
Validation auc = 0.704489
Epoch 7037
Loss = 1.0229e-01, PNorm = 758.6688, GNorm = 3.3522, lr_0 = 9.9514e-04
Validation auc = 0.697716
Epoch 7038
Loss = 8.3754e-03, PNorm = 758.7144, GNorm = 0.2073, lr_0 = 9.9514e-04
Validation auc = 0.692968
Epoch 7039
Loss = 9.8649e-03, PNorm = 758.7505, GNorm = 0.7974, lr_0 = 9.9514e-04
Loss = 5.9383e-02, PNorm = 758.7966, GNorm = 1.6301, lr_0 = 9.9514e-04
Validation auc = 0.694316
Epoch 7040
Loss = 5.5883e-02, PNorm = 758.8591, GNorm = 0.5469, lr_0 = 9.9514e-04
Validation auc = 0.697912
Epoch 7041
Loss = 5.2744e-02, PNorm = 758.9100, GNorm = 0.8929, lr_0 = 9.9514e-04
Validation auc = 0.690972
Epoch 7042
Loss = 3.7282e-02, PNorm = 758.9510, GNorm = 3.4084, lr_0 = 9.9514e-04
Validation auc = 0.692140
Epoch 7043
Loss = 5.1786e-02, PNorm = 758.9888, GNorm = 3.3951, lr_0 = 9.9514e-04
Validation auc = 0.693048
Epoch 7044
Loss = 3.8291e-02, PNorm = 759.0243, GNorm = 1.1324, lr_0 = 9.9514e-04
Validation auc = 0.692504
Epoch 7045
Loss = 4.4062e-02, PNorm = 759.0576, GNorm = 1.1353, lr_0 = 9.9514e-04
Validation auc = 0.695097
Epoch 7046
Loss = 3.0323e-01, PNorm = 759.0846, GNorm = 1.9786, lr_0 = 9.9514e-04
Validation auc = 0.697916
Epoch 7047
Loss = 7.1479e-02, PNorm = 759.1211, GNorm = 3.6778, lr_0 = 9.9514e-04
Validation auc = 0.695681
Epoch 7048
Loss = 7.1372e-02, PNorm = 759.1648, GNorm = 1.9732, lr_0 = 9.9513e-04
Validation auc = 0.698587
Epoch 7049
Loss = 3.5898e-02, PNorm = 759.2052, GNorm = 1.7165, lr_0 = 9.9513e-04
Loss = 4.2792e-02, PNorm = 759.2421, GNorm = 3.6478, lr_0 = 9.9513e-04
Validation auc = 0.702145
Epoch 7050
Loss = 1.9894e-02, PNorm = 759.2778, GNorm = 0.8465, lr_0 = 9.9513e-04
Validation auc = 0.703052
Epoch 7051
Loss = 3.5570e-02, PNorm = 759.3047, GNorm = 0.4171, lr_0 = 9.9513e-04
Validation auc = 0.703479
Epoch 7052
Loss = 9.3334e-02, PNorm = 759.3335, GNorm = 3.5197, lr_0 = 9.9513e-04
Validation auc = 0.701389
Epoch 7053
Loss = 6.9206e-02, PNorm = 759.3628, GNorm = 1.5676, lr_0 = 9.9513e-04
Validation auc = 0.699350
Epoch 7054
Loss = 3.4749e-02, PNorm = 759.3899, GNorm = 0.8515, lr_0 = 9.9513e-04
Validation auc = 0.699634
Epoch 7055
Loss = 1.0445e-01, PNorm = 759.4217, GNorm = 2.1992, lr_0 = 9.9513e-04
Validation auc = 0.693488
Epoch 7056
Loss = 3.8251e-02, PNorm = 759.4590, GNorm = 1.1895, lr_0 = 9.9513e-04
Validation auc = 0.692602
Epoch 7057
Loss = 1.2518e-01, PNorm = 759.4962, GNorm = 9.8538, lr_0 = 9.9513e-04
Validation auc = 0.688576
Epoch 7058
Loss = 9.3169e-03, PNorm = 759.5384, GNorm = 0.2053, lr_0 = 9.9513e-04
Validation auc = 0.684997
Epoch 7059
Loss = 2.9862e-02, PNorm = 759.5672, GNorm = 2.8129, lr_0 = 9.9513e-04
Loss = 2.2567e-02, PNorm = 759.5947, GNorm = 0.2275, lr_0 = 9.9513e-04
Validation auc = 0.683228
Epoch 7060
Loss = 4.6714e-02, PNorm = 759.6229, GNorm = 0.4627, lr_0 = 9.9512e-04
Validation auc = 0.685310
Epoch 7061
Loss = 7.7131e-02, PNorm = 759.6672, GNorm = 2.5699, lr_0 = 9.9512e-04
Validation auc = 0.686978
Epoch 7062
Loss = 3.5809e-02, PNorm = 759.7113, GNorm = 1.2025, lr_0 = 9.9512e-04
Validation auc = 0.685756
Epoch 7063
Loss = 1.2380e-01, PNorm = 759.7475, GNorm = 1.9117, lr_0 = 9.9512e-04
Validation auc = 0.688581
Epoch 7064
Loss = 7.1232e-02, PNorm = 759.7804, GNorm = 1.7575, lr_0 = 9.9512e-04
Validation auc = 0.692268
Epoch 7065
Loss = 3.6232e-02, PNorm = 759.8123, GNorm = 0.9703, lr_0 = 9.9512e-04
Validation auc = 0.688354
Epoch 7066
Loss = 3.1540e-02, PNorm = 759.8504, GNorm = 1.6987, lr_0 = 9.9512e-04
Validation auc = 0.689100
Epoch 7067
Loss = 5.9660e-02, PNorm = 759.8927, GNorm = 0.4933, lr_0 = 9.9512e-04
Validation auc = 0.690954
Epoch 7068
Loss = 5.3579e-03, PNorm = 759.9270, GNorm = 0.1947, lr_0 = 9.9512e-04
Validation auc = 0.689612
Epoch 7069
Loss = 5.4603e-03, PNorm = 759.9548, GNorm = 0.3713, lr_0 = 9.9512e-04
Loss = 7.0047e-02, PNorm = 759.9823, GNorm = 2.2896, lr_0 = 9.9512e-04
Validation auc = 0.689196
Epoch 7070
Loss = 4.8710e-02, PNorm = 760.0166, GNorm = 0.1667, lr_0 = 9.9512e-04
Validation auc = 0.689084
Epoch 7071
Loss = 3.2270e-02, PNorm = 760.0487, GNorm = 0.8311, lr_0 = 9.9512e-04
Validation auc = 0.689478
Epoch 7072
Loss = 3.3926e-02, PNorm = 760.0825, GNorm = 0.3955, lr_0 = 9.9512e-04
Validation auc = 0.684175
Epoch 7073
Loss = 3.6535e-02, PNorm = 760.1211, GNorm = 5.0696, lr_0 = 9.9512e-04
Validation auc = 0.682992
Epoch 7074
Loss = 1.0471e-01, PNorm = 760.1601, GNorm = 0.5832, lr_0 = 9.9511e-04
Validation auc = 0.678483
Epoch 7075
Loss = 5.1633e-02, PNorm = 760.2330, GNorm = 0.3311, lr_0 = 9.9511e-04
Validation auc = 0.679611
Epoch 7076
Loss = 9.6501e-02, PNorm = 760.2940, GNorm = 3.6410, lr_0 = 9.9511e-04
Validation auc = 0.682444
Epoch 7077
Loss = 4.1750e-02, PNorm = 760.3394, GNorm = 2.3323, lr_0 = 9.9511e-04
Validation auc = 0.685408
Epoch 7078
Loss = 1.3048e-01, PNorm = 760.3826, GNorm = 5.4531, lr_0 = 9.9511e-04
Validation auc = 0.690307
Epoch 7079
Loss = 1.5580e-02, PNorm = 760.4338, GNorm = 0.8039, lr_0 = 9.9511e-04
Loss = 1.0085e-01, PNorm = 760.4826, GNorm = 16.0612, lr_0 = 9.9511e-04
Validation auc = 0.691248
Epoch 7080
Loss = 4.9345e-02, PNorm = 760.5455, GNorm = 2.6558, lr_0 = 9.9511e-04
Validation auc = 0.691152
Epoch 7081
Loss = 5.0432e-02, PNorm = 760.6134, GNorm = 2.6726, lr_0 = 9.9511e-04
Validation auc = 0.683765
Epoch 7082
Loss = 5.7961e-02, PNorm = 760.6678, GNorm = 3.9333, lr_0 = 9.9511e-04
Validation auc = 0.680840
Epoch 7083
Loss = 1.1809e-01, PNorm = 760.7104, GNorm = 2.6945, lr_0 = 9.9511e-04
Validation auc = 0.682857
Epoch 7084
Loss = 3.3520e-02, PNorm = 760.7613, GNorm = 0.3048, lr_0 = 9.9511e-04
Validation auc = 0.684983
Epoch 7085
Loss = 3.3429e-02, PNorm = 760.8084, GNorm = 2.4227, lr_0 = 9.9511e-04
Validation auc = 0.684096
Epoch 7086
Loss = 4.2357e-02, PNorm = 760.8506, GNorm = 4.4552, lr_0 = 9.9511e-04
Validation auc = 0.680822
Epoch 7087
Loss = 1.0363e-01, PNorm = 760.9015, GNorm = 5.1950, lr_0 = 9.9510e-04
Validation auc = 0.686214
Epoch 7088
Loss = 7.7106e-02, PNorm = 760.9515, GNorm = 0.3175, lr_0 = 9.9510e-04
Validation auc = 0.683925
Epoch 7089
Loss = 1.6373e-02, PNorm = 760.9938, GNorm = 0.7920, lr_0 = 9.9510e-04
Loss = 3.2819e-02, PNorm = 761.0359, GNorm = 0.3866, lr_0 = 9.9510e-04
Validation auc = 0.677914
Epoch 7090
Loss = 4.1953e-02, PNorm = 761.0701, GNorm = 4.6667, lr_0 = 9.9510e-04
Validation auc = 0.678852
Epoch 7091
Loss = 2.8020e-02, PNorm = 761.1015, GNorm = 1.3379, lr_0 = 9.9510e-04
Validation auc = 0.681507
Epoch 7092
Loss = 3.1658e-02, PNorm = 761.1284, GNorm = 0.2555, lr_0 = 9.9510e-04
Validation auc = 0.685214
Epoch 7093
Loss = 4.5241e-02, PNorm = 761.1526, GNorm = 4.7928, lr_0 = 9.9510e-04
Validation auc = 0.689740
Epoch 7094
Loss = 7.1712e-02, PNorm = 761.1797, GNorm = 8.9564, lr_0 = 9.9510e-04
Validation auc = 0.691318
Epoch 7095
Loss = 2.1167e-02, PNorm = 761.2112, GNorm = 0.2459, lr_0 = 9.9510e-04
Validation auc = 0.692321
Epoch 7096
Loss = 7.0866e-02, PNorm = 761.2370, GNorm = 2.3513, lr_0 = 9.9510e-04
Validation auc = 0.690481
Epoch 7097
Loss = 5.2459e-02, PNorm = 761.2635, GNorm = 2.9722, lr_0 = 9.9510e-04
Validation auc = 0.686777
Epoch 7098
Loss = 2.2982e-02, PNorm = 761.2863, GNorm = 0.6213, lr_0 = 9.9510e-04
Validation auc = 0.682241
Epoch 7099
Loss = 8.9951e-03, PNorm = 761.3174, GNorm = 0.3202, lr_0 = 9.9510e-04
Loss = 4.6320e-02, PNorm = 761.3440, GNorm = 0.2663, lr_0 = 9.9510e-04
Validation auc = 0.683632
Epoch 7100
Loss = 3.9522e-02, PNorm = 761.3773, GNorm = 0.0857, lr_0 = 9.9509e-04
Validation auc = 0.681901
Epoch 7101
Loss = 2.2848e-02, PNorm = 761.4132, GNorm = 0.9736, lr_0 = 9.9509e-04
Validation auc = 0.687164
Epoch 7102
Loss = 3.0733e-02, PNorm = 761.4392, GNorm = 0.8891, lr_0 = 9.9509e-04
Validation auc = 0.692179
Epoch 7103
Loss = 8.2496e-03, PNorm = 761.4596, GNorm = 0.0823, lr_0 = 9.9509e-04
Validation auc = 0.696651
Epoch 7104
Loss = 3.9393e-02, PNorm = 761.4810, GNorm = 2.3392, lr_0 = 9.9509e-04
Validation auc = 0.696589
Epoch 7105
Loss = 1.5068e-02, PNorm = 761.5097, GNorm = 1.1893, lr_0 = 9.9509e-04
Validation auc = 0.693150
Epoch 7106
Loss = 7.1398e-02, PNorm = 761.5405, GNorm = 0.1072, lr_0 = 9.9509e-04
Validation auc = 0.693780
Epoch 7107
Loss = 2.2970e-02, PNorm = 761.5686, GNorm = 2.4269, lr_0 = 9.9509e-04
Validation auc = 0.693940
Epoch 7108
Loss = 4.2622e-02, PNorm = 761.5934, GNorm = 4.2212, lr_0 = 9.9509e-04
Validation auc = 0.694292
Epoch 7109
Loss = 9.0426e-02, PNorm = 761.6145, GNorm = 3.3300, lr_0 = 9.9509e-04
Loss = 3.9342e-02, PNorm = 761.6392, GNorm = 0.8797, lr_0 = 9.9509e-04
Validation auc = 0.689574
Epoch 7110
Loss = 2.6120e-02, PNorm = 761.6703, GNorm = 0.0891, lr_0 = 9.9509e-04
Validation auc = 0.688712
Epoch 7111
Loss = 2.0307e-02, PNorm = 761.6948, GNorm = 0.2347, lr_0 = 9.9509e-04
Validation auc = 0.685853
Epoch 7112
Loss = 2.7337e-02, PNorm = 761.7198, GNorm = 0.7948, lr_0 = 9.9509e-04
Validation auc = 0.679450
Epoch 7113
Loss = 3.4844e-02, PNorm = 761.7439, GNorm = 0.9620, lr_0 = 9.9509e-04
Validation auc = 0.679785
Epoch 7114
Loss = 2.8012e-02, PNorm = 761.7680, GNorm = 0.3809, lr_0 = 9.9508e-04
Validation auc = 0.678336
Epoch 7115
Loss = 5.1648e-02, PNorm = 761.7960, GNorm = 0.4384, lr_0 = 9.9508e-04
Validation auc = 0.677926
Epoch 7116
Loss = 7.0047e-03, PNorm = 761.8298, GNorm = 0.4642, lr_0 = 9.9508e-04
Validation auc = 0.677370
Epoch 7117
Loss = 5.3658e-03, PNorm = 761.8558, GNorm = 0.4520, lr_0 = 9.9508e-04
Validation auc = 0.679020
Epoch 7118
Loss = 1.0014e-02, PNorm = 761.8718, GNorm = 0.4340, lr_0 = 9.9508e-04
Validation auc = 0.682954
Epoch 7119
Loss = 9.6860e-04, PNorm = 761.8962, GNorm = 0.1807, lr_0 = 9.9508e-04
Loss = 2.7387e-02, PNorm = 761.9333, GNorm = 0.6621, lr_0 = 9.9508e-04
Validation auc = 0.685747
Epoch 7120
Loss = 4.4257e-02, PNorm = 761.9675, GNorm = 6.5429, lr_0 = 9.9508e-04
Validation auc = 0.688307
Epoch 7121
Loss = 4.0681e-02, PNorm = 762.0066, GNorm = 2.5068, lr_0 = 9.9508e-04
Validation auc = 0.684418
Epoch 7122
Loss = 2.4305e-02, PNorm = 762.0443, GNorm = 1.2794, lr_0 = 9.9508e-04
Validation auc = 0.682674
Epoch 7123
Loss = 8.4605e-03, PNorm = 762.0707, GNorm = 0.4394, lr_0 = 9.9508e-04
Validation auc = 0.678552
Epoch 7124
Loss = 4.3965e-02, PNorm = 762.0955, GNorm = 0.3725, lr_0 = 9.9508e-04
Validation auc = 0.687198
Epoch 7125
Loss = 5.6171e-02, PNorm = 762.1284, GNorm = 0.2797, lr_0 = 9.9508e-04
Validation auc = 0.685597
Epoch 7126
Loss = 3.0113e-02, PNorm = 762.1654, GNorm = 2.0789, lr_0 = 9.9508e-04
Validation auc = 0.687892
Epoch 7127
Loss = 4.7185e-02, PNorm = 762.2057, GNorm = 1.3515, lr_0 = 9.9507e-04
Validation auc = 0.688340
Epoch 7128
Loss = 3.4854e-02, PNorm = 762.2479, GNorm = 1.3144, lr_0 = 9.9507e-04
Validation auc = 0.690488
Epoch 7129
Loss = 1.8750e-02, PNorm = 762.2897, GNorm = 0.8890, lr_0 = 9.9507e-04
Loss = 3.9636e-02, PNorm = 762.3262, GNorm = 2.8044, lr_0 = 9.9507e-04
Validation auc = 0.686089
Epoch 7130
Loss = 1.9337e-02, PNorm = 762.3634, GNorm = 1.2905, lr_0 = 9.9507e-04
Validation auc = 0.681808
Epoch 7131
Loss = 6.9298e-02, PNorm = 762.3959, GNorm = 0.1415, lr_0 = 9.9507e-04
Validation auc = 0.682941
Epoch 7132
Loss = 4.3548e-02, PNorm = 762.4438, GNorm = 1.9390, lr_0 = 9.9507e-04
Validation auc = 0.692407
Epoch 7133
Loss = 6.5421e-02, PNorm = 762.4873, GNorm = 1.6942, lr_0 = 9.9507e-04
Validation auc = 0.689009
Epoch 7134
Loss = 1.7730e-02, PNorm = 762.5424, GNorm = 0.3583, lr_0 = 9.9507e-04
Validation auc = 0.690932
Epoch 7135
Loss = 2.7833e-02, PNorm = 762.5859, GNorm = 0.7608, lr_0 = 9.9507e-04
Validation auc = 0.692073
Epoch 7136
Loss = 4.8324e-02, PNorm = 762.6231, GNorm = 2.6898, lr_0 = 9.9507e-04
Validation auc = 0.692314
Epoch 7137
Loss = 7.5379e-02, PNorm = 762.6648, GNorm = 1.7970, lr_0 = 9.9507e-04
Validation auc = 0.688172
Epoch 7138
Loss = 8.4746e-03, PNorm = 762.7030, GNorm = 0.4832, lr_0 = 9.9507e-04
Validation auc = 0.684404
Epoch 7139
Loss = 1.4882e-01, PNorm = 762.7312, GNorm = 4.9444, lr_0 = 9.9507e-04
Loss = 1.2865e-01, PNorm = 762.7758, GNorm = 1.2672, lr_0 = 9.9507e-04
Validation auc = 0.689395
Epoch 7140
Loss = 7.5881e-02, PNorm = 762.8526, GNorm = 1.7219, lr_0 = 9.9506e-04
Validation auc = 0.692016
Epoch 7141
Loss = 6.8820e-02, PNorm = 762.9201, GNorm = 0.9462, lr_0 = 9.9506e-04
Validation auc = 0.689373
Epoch 7142
Loss = 1.0736e-01, PNorm = 762.9731, GNorm = 0.3937, lr_0 = 9.9506e-04
Validation auc = 0.683169
Epoch 7143
Loss = 3.7564e-02, PNorm = 763.0213, GNorm = 0.6886, lr_0 = 9.9506e-04
Validation auc = 0.683521
Epoch 7144
Loss = 2.1578e-02, PNorm = 763.0573, GNorm = 0.9806, lr_0 = 9.9506e-04
Validation auc = 0.684260
Epoch 7145
Loss = 5.0765e-02, PNorm = 763.0923, GNorm = 0.4034, lr_0 = 9.9506e-04
Validation auc = 0.683133
Epoch 7146
Loss = 4.7041e-02, PNorm = 763.1283, GNorm = 0.7378, lr_0 = 9.9506e-04
Validation auc = 0.687958
Epoch 7147
Loss = 6.9166e-02, PNorm = 763.1611, GNorm = 4.0785, lr_0 = 9.9506e-04
Validation auc = 0.691052
Epoch 7148
Loss = 7.3030e-02, PNorm = 763.1951, GNorm = 3.1322, lr_0 = 9.9506e-04
Validation auc = 0.691182
Epoch 7149
Loss = 5.6496e-02, PNorm = 763.2367, GNorm = 2.6336, lr_0 = 9.9506e-04
Loss = 5.8575e-02, PNorm = 763.2723, GNorm = 0.6409, lr_0 = 9.9506e-04
Validation auc = 0.691308
Epoch 7150
Loss = 4.9247e-02, PNorm = 763.3120, GNorm = 0.9022, lr_0 = 9.9506e-04
Validation auc = 0.691627
Epoch 7151
Loss = 2.2866e-02, PNorm = 763.3538, GNorm = 0.4807, lr_0 = 9.9506e-04
Validation auc = 0.694475
Epoch 7152
Loss = 3.6833e-02, PNorm = 763.3950, GNorm = 2.3807, lr_0 = 9.9506e-04
Validation auc = 0.694966
Epoch 7153
Loss = 2.3401e-02, PNorm = 763.4295, GNorm = 1.8190, lr_0 = 9.9505e-04
Validation auc = 0.695829
Epoch 7154
Loss = 1.7566e-02, PNorm = 763.4572, GNorm = 1.8658, lr_0 = 9.9505e-04
Validation auc = 0.695959
Epoch 7155
Loss = 6.2495e-02, PNorm = 763.4845, GNorm = 3.1596, lr_0 = 9.9505e-04
Validation auc = 0.691571
Epoch 7156
Loss = 7.2263e-02, PNorm = 763.5250, GNorm = 4.0978, lr_0 = 9.9505e-04
Validation auc = 0.693797
Epoch 7157
Loss = 6.7772e-03, PNorm = 763.5648, GNorm = 0.4037, lr_0 = 9.9505e-04
Validation auc = 0.690613
Epoch 7158
Loss = 4.0355e-02, PNorm = 763.5952, GNorm = 0.3189, lr_0 = 9.9505e-04
Validation auc = 0.687916
Epoch 7159
Loss = 5.6844e-02, PNorm = 763.6296, GNorm = 4.1498, lr_0 = 9.9505e-04
Loss = 2.4713e-02, PNorm = 763.6733, GNorm = 0.5937, lr_0 = 9.9505e-04
Validation auc = 0.685351
Epoch 7160
Loss = 4.8250e-02, PNorm = 763.7076, GNorm = 0.7976, lr_0 = 9.9505e-04
Validation auc = 0.685808
Epoch 7161
Loss = 2.7466e-02, PNorm = 763.7498, GNorm = 1.3252, lr_0 = 9.9505e-04
Validation auc = 0.688175
Epoch 7162
Loss = 8.3828e-02, PNorm = 763.7868, GNorm = 2.0189, lr_0 = 9.9505e-04
Validation auc = 0.682378
Epoch 7163
Loss = 3.7727e-02, PNorm = 763.8310, GNorm = 1.0094, lr_0 = 9.9505e-04
Validation auc = 0.675119
Epoch 7164
Loss = 8.5613e-02, PNorm = 763.8736, GNorm = 0.9180, lr_0 = 9.9505e-04
Validation auc = 0.676982
Epoch 7165
Loss = 7.8609e-02, PNorm = 763.9151, GNorm = 2.3842, lr_0 = 9.9505e-04
Validation auc = 0.677986
Epoch 7166
Loss = 5.0939e-02, PNorm = 763.9661, GNorm = 0.4747, lr_0 = 9.9505e-04
Validation auc = 0.673303
Epoch 7167
Loss = 1.2232e-02, PNorm = 764.0089, GNorm = 0.6772, lr_0 = 9.9504e-04
Validation auc = 0.671367
Epoch 7168
Loss = 1.2536e-03, PNorm = 764.0385, GNorm = 0.0471, lr_0 = 9.9504e-04
Validation auc = 0.671110
Epoch 7169
Loss = 4.6994e-03, PNorm = 764.0739, GNorm = 0.3912, lr_0 = 9.9504e-04
Loss = 3.7454e-02, PNorm = 764.1060, GNorm = 3.9820, lr_0 = 9.9504e-04
Validation auc = 0.671712
Epoch 7170
Loss = 9.0226e-02, PNorm = 764.1434, GNorm = 0.3309, lr_0 = 9.9504e-04
Validation auc = 0.676869
Epoch 7171
Loss = 2.2467e-02, PNorm = 764.1850, GNorm = 1.3008, lr_0 = 9.9504e-04
Validation auc = 0.675249
Epoch 7172
Loss = 4.4331e-02, PNorm = 764.2193, GNorm = 1.2949, lr_0 = 9.9504e-04
Validation auc = 0.673557
Epoch 7173
Loss = 4.9060e-02, PNorm = 764.2527, GNorm = 1.5141, lr_0 = 9.9504e-04
Validation auc = 0.672374
Epoch 7174
Loss = 5.1360e-02, PNorm = 764.2937, GNorm = 6.2886, lr_0 = 9.9504e-04
Validation auc = 0.674878
Epoch 7175
Loss = 7.1154e-02, PNorm = 764.3312, GNorm = 2.4194, lr_0 = 9.9504e-04
Validation auc = 0.679125
Epoch 7176
Loss = 4.2916e-02, PNorm = 764.3869, GNorm = 5.1765, lr_0 = 9.9504e-04
Validation auc = 0.679705
Epoch 7177
Loss = 1.8646e-02, PNorm = 764.4589, GNorm = 1.6932, lr_0 = 9.9504e-04
Validation auc = 0.681207
Epoch 7178
Loss = 2.6847e-02, PNorm = 764.5124, GNorm = 3.5350, lr_0 = 9.9504e-04
Validation auc = 0.687238
Epoch 7179
Loss = 3.7280e-02, PNorm = 764.5628, GNorm = 2.1493, lr_0 = 9.9504e-04
Loss = 7.5632e-02, PNorm = 764.6162, GNorm = 0.8809, lr_0 = 9.9504e-04
Validation auc = 0.699206
Epoch 7180
Loss = 6.4661e-02, PNorm = 764.6677, GNorm = 3.0792, lr_0 = 9.9503e-04
Validation auc = 0.705210
Epoch 7181
Loss = 9.0942e-02, PNorm = 764.7230, GNorm = 3.8358, lr_0 = 9.9503e-04
Validation auc = 0.711788
Epoch 7182
Loss = 4.0389e-02, PNorm = 764.7939, GNorm = 0.7250, lr_0 = 9.9503e-04
Validation auc = 0.706883
Epoch 7183
Loss = 6.2264e-02, PNorm = 764.8542, GNorm = 1.4541, lr_0 = 9.9503e-04
Validation auc = 0.697012
Epoch 7184
Loss = 4.4064e-02, PNorm = 764.9047, GNorm = 3.0560, lr_0 = 9.9503e-04
Validation auc = 0.695738
Epoch 7185
Loss = 3.0504e-02, PNorm = 764.9429, GNorm = 1.7298, lr_0 = 9.9503e-04
Validation auc = 0.695938
Epoch 7186
Loss = 1.6081e-02, PNorm = 764.9713, GNorm = 0.2676, lr_0 = 9.9503e-04
Validation auc = 0.689787
Epoch 7187
Loss = 8.2234e-02, PNorm = 765.0008, GNorm = 2.1051, lr_0 = 9.9503e-04
Validation auc = 0.688036
Epoch 7188
Loss = 1.2910e-02, PNorm = 765.0313, GNorm = 0.1488, lr_0 = 9.9503e-04
Validation auc = 0.691432
Epoch 7189
Loss = 7.5589e-03, PNorm = 765.0686, GNorm = 0.3473, lr_0 = 9.9503e-04
Loss = 3.0228e-02, PNorm = 765.1070, GNorm = 0.6429, lr_0 = 9.9503e-04
Validation auc = 0.688298
Epoch 7190
Loss = 2.8457e-02, PNorm = 765.1412, GNorm = 0.1267, lr_0 = 9.9503e-04
Validation auc = 0.685328
Epoch 7191
Loss = 3.4327e-02, PNorm = 765.1771, GNorm = 10.5658, lr_0 = 9.9503e-04
Validation auc = 0.685855
Epoch 7192
Loss = 8.0102e-02, PNorm = 765.2284, GNorm = 7.5768, lr_0 = 9.9503e-04
Validation auc = 0.683195
Epoch 7193
Loss = 5.2344e-02, PNorm = 765.2867, GNorm = 0.3125, lr_0 = 9.9502e-04
Validation auc = 0.690048
Epoch 7194
Loss = 2.2922e-02, PNorm = 765.3429, GNorm = 0.7588, lr_0 = 9.9502e-04
Validation auc = 0.684076
Epoch 7195
Loss = 2.5623e-01, PNorm = 765.3979, GNorm = 2.3409, lr_0 = 9.9502e-04
Validation auc = 0.685559
Epoch 7196
Loss = 7.9649e-02, PNorm = 765.4798, GNorm = 1.4700, lr_0 = 9.9502e-04
Validation auc = 0.678552
Epoch 7197
Loss = 5.3471e-02, PNorm = 765.5466, GNorm = 1.2307, lr_0 = 9.9502e-04
Validation auc = 0.675340
Epoch 7198
Loss = 1.2401e-01, PNorm = 765.5962, GNorm = 1.6077, lr_0 = 9.9502e-04
Validation auc = 0.678540
Epoch 7199
Loss = 3.7940e-02, PNorm = 765.6450, GNorm = 0.9171, lr_0 = 9.9502e-04
Loss = 7.2551e-02, PNorm = 765.6963, GNorm = 1.6337, lr_0 = 9.9502e-04
Validation auc = 0.672089
Epoch 7200
Loss = 6.6326e-02, PNorm = 765.7529, GNorm = 1.8071, lr_0 = 9.9502e-04
Validation auc = 0.675378
Epoch 7201
Loss = 4.4826e-02, PNorm = 765.8025, GNorm = 0.7798, lr_0 = 9.9502e-04
Validation auc = 0.677735
Epoch 7202
Loss = 1.9289e-02, PNorm = 765.8372, GNorm = 2.4238, lr_0 = 9.9502e-04
Validation auc = 0.679097
Epoch 7203
Loss = 7.8927e-03, PNorm = 765.8610, GNorm = 0.3355, lr_0 = 9.9502e-04
Validation auc = 0.680154
Epoch 7204
Loss = 3.8618e-02, PNorm = 765.8836, GNorm = 2.3556, lr_0 = 9.9502e-04
Validation auc = 0.670395
Epoch 7205
Loss = 3.5956e-02, PNorm = 765.9175, GNorm = 3.5759, lr_0 = 9.9502e-04
Validation auc = 0.663789
Epoch 7206
Loss = 4.0817e-02, PNorm = 765.9511, GNorm = 1.2136, lr_0 = 9.9502e-04
Validation auc = 0.669028
Epoch 7207
Loss = 1.2436e-01, PNorm = 765.9790, GNorm = 7.5615, lr_0 = 9.9501e-04
Validation auc = 0.665680
Epoch 7208
Loss = 9.0611e-02, PNorm = 766.0144, GNorm = 4.2242, lr_0 = 9.9501e-04
Validation auc = 0.663289
Epoch 7209
Loss = 8.3642e-03, PNorm = 766.0489, GNorm = 0.6102, lr_0 = 9.9501e-04
Loss = 5.2577e-02, PNorm = 766.0872, GNorm = 7.4707, lr_0 = 9.9501e-04
Validation auc = 0.661296
Epoch 7210
Loss = 5.1672e-02, PNorm = 766.1294, GNorm = 1.8376, lr_0 = 9.9501e-04
Validation auc = 0.658503
Epoch 7211
Loss = 3.4085e-02, PNorm = 766.1751, GNorm = 4.5510, lr_0 = 9.9501e-04
Validation auc = 0.662630
Epoch 7212
Loss = 4.9973e-02, PNorm = 766.2196, GNorm = 2.4590, lr_0 = 9.9501e-04
Validation auc = 0.672130
Epoch 7213
Loss = 3.6693e-02, PNorm = 766.2661, GNorm = 3.3777, lr_0 = 9.9501e-04
Validation auc = 0.676076
Epoch 7214
Loss = 3.2901e-02, PNorm = 766.3097, GNorm = 1.5988, lr_0 = 9.9501e-04
Validation auc = 0.676305
Epoch 7215
Loss = 8.1949e-02, PNorm = 766.3497, GNorm = 6.3382, lr_0 = 9.9501e-04
Validation auc = 0.662636
Epoch 7216
Loss = 1.3519e-02, PNorm = 766.3953, GNorm = 0.3448, lr_0 = 9.9501e-04
Validation auc = 0.661876
Epoch 7217
Loss = 3.3524e-02, PNorm = 766.4314, GNorm = 0.9465, lr_0 = 9.9501e-04
Validation auc = 0.665614
Epoch 7218
Loss = 4.5485e-03, PNorm = 766.4806, GNorm = 0.3488, lr_0 = 9.9501e-04
Validation auc = 0.668331
Epoch 7219
Loss = 2.5436e-03, PNorm = 766.5178, GNorm = 0.2065, lr_0 = 9.9501e-04
Loss = 5.4222e-02, PNorm = 766.5496, GNorm = 0.4397, lr_0 = 9.9500e-04
Validation auc = 0.673425
Epoch 7220
Loss = 3.5281e-02, PNorm = 766.5946, GNorm = 2.2411, lr_0 = 9.9500e-04
Validation auc = 0.678052
Epoch 7221
Loss = 2.9543e-02, PNorm = 766.6375, GNorm = 4.0732, lr_0 = 9.9500e-04
Validation auc = 0.667985
Epoch 7222
Loss = 4.4722e-02, PNorm = 766.6754, GNorm = 8.3837, lr_0 = 9.9500e-04
Validation auc = 0.663089
Epoch 7223
Loss = 5.9146e-02, PNorm = 766.7205, GNorm = 3.1632, lr_0 = 9.9500e-04
Validation auc = 0.669416
Epoch 7224
Loss = 3.0233e-02, PNorm = 766.7741, GNorm = 2.3801, lr_0 = 9.9500e-04
Validation auc = 0.671554
Epoch 7225
Loss = 8.0019e-02, PNorm = 766.8282, GNorm = 8.0534, lr_0 = 9.9500e-04
Validation auc = 0.676110
Epoch 7226
Loss = 4.1003e-02, PNorm = 766.8806, GNorm = 1.6445, lr_0 = 9.9500e-04
Validation auc = 0.679076
Epoch 7227
Loss = 1.9365e-01, PNorm = 766.9377, GNorm = 12.4256, lr_0 = 9.9500e-04
Validation auc = 0.672464
Epoch 7228
Loss = 1.1982e-01, PNorm = 766.9978, GNorm = 5.5907, lr_0 = 9.9500e-04
Validation auc = 0.674151
Epoch 7229
Loss = 9.0891e-02, PNorm = 767.0417, GNorm = 3.7892, lr_0 = 9.9500e-04
Loss = 4.2669e-02, PNorm = 767.0869, GNorm = 8.0283, lr_0 = 9.9500e-04
Validation auc = 0.673999
Epoch 7230
Loss = 4.0307e-02, PNorm = 767.1319, GNorm = 0.1958, lr_0 = 9.9500e-04
Validation auc = 0.677880
Epoch 7231
Loss = 5.8155e-02, PNorm = 767.1740, GNorm = 0.6078, lr_0 = 9.9500e-04
Validation auc = 0.680582
Epoch 7232
Loss = 1.6199e-02, PNorm = 767.2156, GNorm = 1.0687, lr_0 = 9.9500e-04
Validation auc = 0.681418
Epoch 7233
Loss = 2.1536e-02, PNorm = 767.2487, GNorm = 0.3456, lr_0 = 9.9499e-04
Validation auc = 0.688976
Epoch 7234
Loss = 5.3268e-02, PNorm = 767.2797, GNorm = 7.5309, lr_0 = 9.9499e-04
Validation auc = 0.685791
Epoch 7235
Loss = 6.1327e-02, PNorm = 767.3300, GNorm = 1.5600, lr_0 = 9.9499e-04
Validation auc = 0.682791
Epoch 7236
Loss = 4.2183e-02, PNorm = 767.3856, GNorm = 1.2873, lr_0 = 9.9499e-04
Validation auc = 0.670984
Epoch 7237
Loss = 1.6421e-02, PNorm = 767.4415, GNorm = 1.7667, lr_0 = 9.9499e-04
Validation auc = 0.661845
Epoch 7238
Loss = 4.7788e-02, PNorm = 767.4933, GNorm = 3.4472, lr_0 = 9.9499e-04
Validation auc = 0.677321
Epoch 7239
Loss = 8.9340e-03, PNorm = 767.5904, GNorm = 0.4704, lr_0 = 9.9499e-04
Loss = 3.6180e-02, PNorm = 767.7290, GNorm = 1.9770, lr_0 = 9.9499e-04
Validation auc = 0.691360
Epoch 7240
Loss = 1.2592e-01, PNorm = 767.8207, GNorm = 7.5752, lr_0 = 9.9499e-04
Validation auc = 0.683982
Epoch 7241
Loss = 1.1779e-01, PNorm = 767.9236, GNorm = 1.8953, lr_0 = 9.9499e-04
Validation auc = 0.679779
Epoch 7242
Loss = 5.9734e-02, PNorm = 768.0409, GNorm = 2.8975, lr_0 = 9.9499e-04
Validation auc = 0.673826
Epoch 7243
Loss = 1.0302e-01, PNorm = 768.1430, GNorm = 1.5616, lr_0 = 9.9499e-04
Validation auc = 0.678278
Epoch 7244
Loss = 1.0212e-01, PNorm = 768.2332, GNorm = 2.1180, lr_0 = 9.9499e-04
Validation auc = 0.690974
Epoch 7245
Loss = 5.2562e-02, PNorm = 768.3170, GNorm = 2.7462, lr_0 = 9.9499e-04
Validation auc = 0.701487
Epoch 7246
Loss = 5.0082e-02, PNorm = 768.3769, GNorm = 3.3446, lr_0 = 9.9499e-04
Validation auc = 0.702885
Epoch 7247
Loss = 1.3758e-01, PNorm = 768.4200, GNorm = 5.2227, lr_0 = 9.9498e-04
Validation auc = 0.693539
Epoch 7248
Loss = 3.3787e-02, PNorm = 768.4798, GNorm = 0.9117, lr_0 = 9.9498e-04
Validation auc = 0.690023
Epoch 7249
Loss = 1.8471e-01, PNorm = 768.5360, GNorm = 4.5972, lr_0 = 9.9498e-04
Loss = 5.8483e-02, PNorm = 768.5775, GNorm = 0.9814, lr_0 = 9.9498e-04
Validation auc = 0.690117
Epoch 7250
Loss = 7.2778e-02, PNorm = 768.6214, GNorm = 8.4379, lr_0 = 9.9498e-04
Validation auc = 0.692037
Epoch 7251
Loss = 2.1992e-02, PNorm = 768.6738, GNorm = 1.8201, lr_0 = 9.9498e-04
Validation auc = 0.692870
Epoch 7252
Loss = 5.1406e-02, PNorm = 768.7128, GNorm = 0.4991, lr_0 = 9.9498e-04
Validation auc = 0.693036
Epoch 7253
Loss = 3.2321e-02, PNorm = 768.7486, GNorm = 5.3244, lr_0 = 9.9498e-04
Validation auc = 0.691952
Epoch 7254
Loss = 1.0224e-01, PNorm = 768.7827, GNorm = 4.4180, lr_0 = 9.9498e-04
Validation auc = 0.687472
Epoch 7255
Loss = 1.7073e-01, PNorm = 768.8210, GNorm = 3.9688, lr_0 = 9.9498e-04
Validation auc = 0.688350
Epoch 7256
Loss = 4.1306e-02, PNorm = 768.8665, GNorm = 6.7096, lr_0 = 9.9498e-04
Validation auc = 0.686961
Epoch 7257
Loss = 6.1783e-02, PNorm = 768.9203, GNorm = 3.2262, lr_0 = 9.9498e-04
Validation auc = 0.682704
Epoch 7258
Loss = 1.6380e-01, PNorm = 768.9752, GNorm = 3.3436, lr_0 = 9.9498e-04
Validation auc = 0.681910
Epoch 7259
Loss = 3.0430e-02, PNorm = 769.0263, GNorm = 0.9028, lr_0 = 9.9498e-04
Loss = 4.8525e-02, PNorm = 769.0696, GNorm = 1.7935, lr_0 = 9.9497e-04
Validation auc = 0.685323
Epoch 7260
Loss = 4.6452e-02, PNorm = 769.1077, GNorm = 0.2221, lr_0 = 9.9497e-04
Validation auc = 0.681618
Epoch 7261
Loss = 7.4793e-02, PNorm = 769.1403, GNorm = 0.9677, lr_0 = 9.9497e-04
Validation auc = 0.685921
Epoch 7262
Loss = 3.8102e-02, PNorm = 769.1863, GNorm = 0.6058, lr_0 = 9.9497e-04
Validation auc = 0.684036
Epoch 7263
Loss = 5.2066e-02, PNorm = 769.2316, GNorm = 3.4810, lr_0 = 9.9497e-04
Validation auc = 0.680032
Epoch 7264
Loss = 4.1605e-02, PNorm = 769.2729, GNorm = 0.7603, lr_0 = 9.9497e-04
Validation auc = 0.679548
Epoch 7265
Loss = 1.9069e-01, PNorm = 769.3200, GNorm = 1.4177, lr_0 = 9.9497e-04
Validation auc = 0.684545
Epoch 7266
Loss = 3.0599e-02, PNorm = 769.3852, GNorm = 1.9214, lr_0 = 9.9497e-04
Validation auc = 0.687083
Epoch 7267
Loss = 4.1311e-02, PNorm = 769.4279, GNorm = 0.3933, lr_0 = 9.9497e-04
Validation auc = 0.689209
Epoch 7268
Loss = 2.7564e-01, PNorm = 769.4632, GNorm = 11.2688, lr_0 = 9.9497e-04
Validation auc = 0.687887
Epoch 7269
Loss = 7.4707e-02, PNorm = 769.5199, GNorm = 1.6475, lr_0 = 9.9497e-04
Loss = 6.9870e-02, PNorm = 769.5775, GNorm = 2.2508, lr_0 = 9.9497e-04
Validation auc = 0.686170
Epoch 7270
Loss = 5.2543e-02, PNorm = 769.6260, GNorm = 0.9306, lr_0 = 9.9497e-04
Validation auc = 0.685880
Epoch 7271
Loss = 5.3864e-02, PNorm = 769.6611, GNorm = 0.3634, lr_0 = 9.9497e-04
Validation auc = 0.684108
Epoch 7272
Loss = 1.5302e-01, PNorm = 769.7105, GNorm = 0.6751, lr_0 = 9.9497e-04
Validation auc = 0.679374
Epoch 7273
Loss = 4.4620e-02, PNorm = 769.7739, GNorm = 1.4189, lr_0 = 9.9496e-04
Validation auc = 0.683435
Epoch 7274
Loss = 5.8567e-01, PNorm = 769.8587, GNorm = 0.9456, lr_0 = 9.9496e-04
Validation auc = 0.671425
Epoch 7275
Loss = 1.1889e-01, PNorm = 769.9554, GNorm = 7.5185, lr_0 = 9.9496e-04
Validation auc = 0.670384
Epoch 7276
Loss = 4.6664e-02, PNorm = 770.0319, GNorm = 1.1395, lr_0 = 9.9496e-04
Validation auc = 0.663481
Epoch 7277
Loss = 6.9348e-02, PNorm = 770.1016, GNorm = 0.3418, lr_0 = 9.9496e-04
Validation auc = 0.657651
Epoch 7278
Loss = 5.4642e-01, PNorm = 770.1689, GNorm = 25.8519, lr_0 = 9.9496e-04
Validation auc = 0.664745
Epoch 7279
Loss = 4.0005e-02, PNorm = 770.2337, GNorm = 2.8981, lr_0 = 9.9496e-04
Loss = 8.5308e-02, PNorm = 770.2898, GNorm = 1.8617, lr_0 = 9.9496e-04
Validation auc = 0.661314
Epoch 7280
Loss = 6.0635e-02, PNorm = 770.3354, GNorm = 3.1270, lr_0 = 9.9496e-04
Validation auc = 0.662310
Epoch 7281
Loss = 7.0769e-02, PNorm = 770.3750, GNorm = 0.8170, lr_0 = 9.9496e-04
Validation auc = 0.666474
Epoch 7282
Loss = 5.1599e-02, PNorm = 770.4290, GNorm = 0.8497, lr_0 = 9.9496e-04
Validation auc = 0.668186
Epoch 7283
Loss = 3.6624e-02, PNorm = 770.4788, GNorm = 1.0529, lr_0 = 9.9496e-04
Validation auc = 0.674044
Epoch 7284
Loss = 3.4905e-02, PNorm = 770.5148, GNorm = 0.6516, lr_0 = 9.9496e-04
Validation auc = 0.679648
Epoch 7285
Loss = 2.7302e-02, PNorm = 770.5442, GNorm = 0.2999, lr_0 = 9.9496e-04
Validation auc = 0.684079
Epoch 7286
Loss = 3.3267e-02, PNorm = 770.5730, GNorm = 5.3523, lr_0 = 9.9495e-04
Validation auc = 0.683797
Epoch 7287
Loss = 3.2642e-02, PNorm = 770.6111, GNorm = 2.7272, lr_0 = 9.9495e-04
Validation auc = 0.689045
Epoch 7288
Loss = 1.2501e-02, PNorm = 770.6502, GNorm = 2.5623, lr_0 = 9.9495e-04
Validation auc = 0.694055
Epoch 7289
Loss = 2.2744e-01, PNorm = 770.6827, GNorm = 4.9393, lr_0 = 9.9495e-04
Loss = 8.6090e-02, PNorm = 770.7192, GNorm = 1.3185, lr_0 = 9.9495e-04
Validation auc = 0.690448
Epoch 7290
Loss = 5.5677e-02, PNorm = 770.7593, GNorm = 0.5739, lr_0 = 9.9495e-04
Validation auc = 0.691513
Epoch 7291
Loss = 5.3380e-02, PNorm = 770.7969, GNorm = 2.5324, lr_0 = 9.9495e-04
Validation auc = 0.688604
Epoch 7292
Loss = 1.6648e-01, PNorm = 770.8495, GNorm = 1.2028, lr_0 = 9.9495e-04
Validation auc = 0.687273
Epoch 7293
Loss = 6.8714e-02, PNorm = 770.9309, GNorm = 1.4250, lr_0 = 9.9495e-04
Validation auc = 0.683067
Epoch 7294
Loss = 8.4825e-02, PNorm = 771.0010, GNorm = 4.2138, lr_0 = 9.9495e-04
Validation auc = 0.677888
Epoch 7295
Loss = 4.6171e-02, PNorm = 771.0581, GNorm = 3.4673, lr_0 = 9.9495e-04
Validation auc = 0.674539
Epoch 7296
Loss = 2.8580e-02, PNorm = 771.0989, GNorm = 0.9854, lr_0 = 9.9495e-04
Validation auc = 0.676114
Epoch 7297
Loss = 4.9042e-02, PNorm = 771.1345, GNorm = 1.8137, lr_0 = 9.9495e-04
Validation auc = 0.679525
Epoch 7298
Loss = 3.0477e-02, PNorm = 771.1693, GNorm = 2.1470, lr_0 = 9.9495e-04
Validation auc = 0.681362
Epoch 7299
Loss = 1.1007e-01, PNorm = 771.1964, GNorm = 4.0620, lr_0 = 9.9495e-04
Loss = 5.8799e-02, PNorm = 771.2296, GNorm = 0.6002, lr_0 = 9.9494e-04
Validation auc = 0.682162
Epoch 7300
Loss = 2.7505e-02, PNorm = 771.2585, GNorm = 0.6550, lr_0 = 9.9494e-04
Validation auc = 0.682863
Epoch 7301
Loss = 5.9745e-02, PNorm = 771.2884, GNorm = 0.2685, lr_0 = 9.9494e-04
Validation auc = 0.683719
Epoch 7302
Loss = 2.3343e-02, PNorm = 771.3147, GNorm = 1.4094, lr_0 = 9.9494e-04
Validation auc = 0.683616
Epoch 7303
Loss = 4.1298e-02, PNorm = 771.3415, GNorm = 3.4500, lr_0 = 9.9494e-04
Validation auc = 0.682567
Epoch 7304
Loss = 4.1483e-02, PNorm = 771.3678, GNorm = 2.0320, lr_0 = 9.9494e-04
Validation auc = 0.682479
Epoch 7305
Loss = 1.5257e-01, PNorm = 771.4028, GNorm = 23.5064, lr_0 = 9.9494e-04
Validation auc = 0.679566
Epoch 7306
Loss = 5.4038e-02, PNorm = 771.4638, GNorm = 9.1885, lr_0 = 9.9494e-04
Validation auc = 0.668972
Epoch 7307
Loss = 4.2810e-02, PNorm = 771.5275, GNorm = 2.8596, lr_0 = 9.9494e-04
Validation auc = 0.659176
Epoch 7308
Loss = 1.1887e-02, PNorm = 771.5806, GNorm = 0.9016, lr_0 = 9.9494e-04
Validation auc = 0.654811
Epoch 7309
Loss = 6.8606e-02, PNorm = 771.6218, GNorm = 3.8547, lr_0 = 9.9494e-04
Loss = 3.3666e-02, PNorm = 771.6685, GNorm = 0.3960, lr_0 = 9.9494e-04
Validation auc = 0.653078
Epoch 7310
Loss = 6.1304e-02, PNorm = 771.7008, GNorm = 1.2551, lr_0 = 9.9494e-04
Validation auc = 0.654291
Epoch 7311
Loss = 2.5866e-02, PNorm = 771.7362, GNorm = 0.1333, lr_0 = 9.9494e-04
Validation auc = 0.659525
Epoch 7312
Loss = 6.3585e-02, PNorm = 771.7706, GNorm = 1.4950, lr_0 = 9.9494e-04
Validation auc = 0.663962
Epoch 7313
Loss = 1.3117e-02, PNorm = 771.8054, GNorm = 0.3721, lr_0 = 9.9493e-04
Validation auc = 0.667970
Epoch 7314
Loss = 2.7349e-02, PNorm = 771.8311, GNorm = 0.3393, lr_0 = 9.9493e-04
Validation auc = 0.667867
Epoch 7315
Loss = 5.2907e-02, PNorm = 771.8519, GNorm = 0.5656, lr_0 = 9.9493e-04
Validation auc = 0.667827
Epoch 7316
Loss = 7.4527e-02, PNorm = 771.8807, GNorm = 1.4803, lr_0 = 9.9493e-04
Validation auc = 0.673398
Epoch 7317
Loss = 7.5207e-02, PNorm = 771.9338, GNorm = 3.6747, lr_0 = 9.9493e-04
Validation auc = 0.670750
Epoch 7318
Loss = 3.3178e-02, PNorm = 771.9896, GNorm = 2.4093, lr_0 = 9.9493e-04
Validation auc = 0.669928
Epoch 7319
Loss = 4.0918e-02, PNorm = 772.0363, GNorm = 0.9662, lr_0 = 9.9493e-04
Loss = 5.0896e-02, PNorm = 772.0756, GNorm = 1.4095, lr_0 = 9.9493e-04
Validation auc = 0.670502
Epoch 7320
Loss = 3.8285e-02, PNorm = 772.1177, GNorm = 0.6750, lr_0 = 9.9493e-04
Validation auc = 0.669008
Epoch 7321
Loss = 1.0306e-01, PNorm = 772.1662, GNorm = 1.8399, lr_0 = 9.9493e-04
Validation auc = 0.670966
Epoch 7322
Loss = 2.1954e-02, PNorm = 772.2136, GNorm = 0.6826, lr_0 = 9.9493e-04
Validation auc = 0.672973
Epoch 7323
Loss = 2.7675e-02, PNorm = 772.2456, GNorm = 2.0911, lr_0 = 9.9493e-04
Validation auc = 0.677596
Epoch 7324
Loss = 6.1134e-02, PNorm = 772.2805, GNorm = 4.8293, lr_0 = 9.9493e-04
Validation auc = 0.680021
Epoch 7325
Loss = 5.2823e-02, PNorm = 772.3220, GNorm = 1.8172, lr_0 = 9.9493e-04
Validation auc = 0.678939
Epoch 7326
Loss = 1.6917e-01, PNorm = 772.3712, GNorm = 69.5076, lr_0 = 9.9492e-04
Validation auc = 0.684572
Epoch 7327
Loss = 1.7515e-02, PNorm = 772.4660, GNorm = 2.1974, lr_0 = 9.9492e-04
Validation auc = 0.693212
Epoch 7328
Loss = 3.7811e-02, PNorm = 772.5329, GNorm = 2.1899, lr_0 = 9.9492e-04
Validation auc = 0.697520
Epoch 7329
Loss = 2.3506e-02, PNorm = 772.5800, GNorm = 1.3381, lr_0 = 9.9492e-04
Loss = 4.7405e-02, PNorm = 772.6246, GNorm = 4.9631, lr_0 = 9.9492e-04
Validation auc = 0.699698
Epoch 7330
Loss = 3.0551e-02, PNorm = 772.6646, GNorm = 0.4684, lr_0 = 9.9492e-04
Validation auc = 0.697465
Epoch 7331
Loss = 5.4817e-02, PNorm = 772.6993, GNorm = 0.8371, lr_0 = 9.9492e-04
Validation auc = 0.691902
Epoch 7332
Loss = 2.5314e-02, PNorm = 772.7393, GNorm = 0.6563, lr_0 = 9.9492e-04
Validation auc = 0.684085
Epoch 7333
Loss = 4.5279e-02, PNorm = 772.7896, GNorm = 2.7444, lr_0 = 9.9492e-04
Validation auc = 0.678704
Epoch 7334
Loss = 4.7462e-02, PNorm = 772.8538, GNorm = 21.5514, lr_0 = 9.9492e-04
Validation auc = 0.675126
Epoch 7335
Loss = 1.4790e-02, PNorm = 772.9090, GNorm = 0.8901, lr_0 = 9.9492e-04
Validation auc = 0.672850
Epoch 7336
Loss = 6.2237e-02, PNorm = 772.9626, GNorm = 2.9155, lr_0 = 9.9492e-04
Validation auc = 0.677354
Epoch 7337
Loss = 8.0596e-02, PNorm = 773.0262, GNorm = 1.8006, lr_0 = 9.9492e-04
Validation auc = 0.679918
Epoch 7338
Loss = 3.3296e-02, PNorm = 773.0764, GNorm = 1.3489, lr_0 = 9.9492e-04
Validation auc = 0.675985
Epoch 7339
Loss = 8.4774e-02, PNorm = 773.1270, GNorm = 2.8385, lr_0 = 9.9492e-04
Loss = 5.1823e-02, PNorm = 773.1734, GNorm = 10.0781, lr_0 = 9.9491e-04
Validation auc = 0.674219
Epoch 7340
Loss = 4.4806e-02, PNorm = 773.2207, GNorm = 3.1849, lr_0 = 9.9491e-04
Validation auc = 0.673378
Epoch 7341
Loss = 4.9231e-02, PNorm = 773.2717, GNorm = 3.9025, lr_0 = 9.9491e-04
Validation auc = 0.671091
Epoch 7342
Loss = 4.6852e-02, PNorm = 773.3180, GNorm = 5.4734, lr_0 = 9.9491e-04
Validation auc = 0.673480
Epoch 7343
Loss = 6.4745e-02, PNorm = 773.3630, GNorm = 0.9505, lr_0 = 9.9491e-04
Validation auc = 0.674563
Epoch 7344
Loss = 6.3421e-02, PNorm = 773.4196, GNorm = 2.5181, lr_0 = 9.9491e-04
Validation auc = 0.674532
Epoch 7345
Loss = 3.1139e-02, PNorm = 773.4778, GNorm = 0.9689, lr_0 = 9.9491e-04
Validation auc = 0.674801
Epoch 7346
Loss = 4.9988e-02, PNorm = 773.5195, GNorm = 3.3188, lr_0 = 9.9491e-04
Validation auc = 0.678827
Epoch 7347
Loss = 4.0278e-02, PNorm = 773.5647, GNorm = 0.2579, lr_0 = 9.9491e-04
Validation auc = 0.684942
Epoch 7348
Loss = 1.6175e-01, PNorm = 773.6110, GNorm = 9.3407, lr_0 = 9.9491e-04
Validation auc = 0.683964
Epoch 7349
Loss = 7.1322e-02, PNorm = 773.6599, GNorm = 7.7337, lr_0 = 9.9491e-04
Loss = 6.4686e-02, PNorm = 773.7057, GNorm = 1.2306, lr_0 = 9.9491e-04
Validation auc = 0.683771
Epoch 7350
Loss = 5.4723e-02, PNorm = 773.7472, GNorm = 0.8661, lr_0 = 9.9491e-04
Validation auc = 0.685063
Epoch 7351
Loss = 3.8928e-02, PNorm = 773.7870, GNorm = 1.8724, lr_0 = 9.9491e-04
Validation auc = 0.685639
Epoch 7352
Loss = 4.7885e-02, PNorm = 773.8230, GNorm = 0.3762, lr_0 = 9.9490e-04
Validation auc = 0.688414
Epoch 7353
Loss = 2.8658e-02, PNorm = 773.8561, GNorm = 0.4246, lr_0 = 9.9490e-04
Validation auc = 0.688975
Epoch 7354
Loss = 2.3491e-02, PNorm = 773.8837, GNorm = 1.3715, lr_0 = 9.9490e-04
Validation auc = 0.688027
Epoch 7355
Loss = 1.4264e-02, PNorm = 773.9116, GNorm = 0.3026, lr_0 = 9.9490e-04
Validation auc = 0.690424
Epoch 7356
Loss = 3.6381e-02, PNorm = 773.9368, GNorm = 4.4629, lr_0 = 9.9490e-04
Validation auc = 0.696946
Epoch 7357
Loss = 6.5024e-02, PNorm = 773.9768, GNorm = 3.8856, lr_0 = 9.9490e-04
Validation auc = 0.696679
Epoch 7358
Loss = 2.2368e-02, PNorm = 774.0254, GNorm = 1.0743, lr_0 = 9.9490e-04
Validation auc = 0.695778
Epoch 7359
Loss = 6.9856e-02, PNorm = 774.0636, GNorm = 2.7273, lr_0 = 9.9490e-04
Loss = 7.0525e-02, PNorm = 774.0968, GNorm = 0.2402, lr_0 = 9.9490e-04
Validation auc = 0.690999
Epoch 7360
Loss = 9.0121e-02, PNorm = 774.1394, GNorm = 0.7428, lr_0 = 9.9490e-04
Validation auc = 0.684655
Epoch 7361
Loss = 3.5844e-02, PNorm = 774.1849, GNorm = 2.7942, lr_0 = 9.9490e-04
Validation auc = 0.683753
Epoch 7362
Loss = 7.5400e-02, PNorm = 774.2373, GNorm = 0.3075, lr_0 = 9.9490e-04
Validation auc = 0.681505
Epoch 7363
Loss = 1.2843e-01, PNorm = 774.2884, GNorm = 0.6252, lr_0 = 9.9490e-04
Validation auc = 0.680684
Epoch 7364
Loss = 1.2605e-01, PNorm = 774.3463, GNorm = 6.9769, lr_0 = 9.9490e-04
Validation auc = 0.681423
Epoch 7365
Loss = 3.9930e-02, PNorm = 774.4034, GNorm = 2.5957, lr_0 = 9.9490e-04
Validation auc = 0.680638
Epoch 7366
Loss = 3.1145e-02, PNorm = 774.4531, GNorm = 1.3808, lr_0 = 9.9489e-04
Validation auc = 0.683202
Epoch 7367
Loss = 5.6018e-02, PNorm = 774.4910, GNorm = 1.1494, lr_0 = 9.9489e-04
Validation auc = 0.687842
Epoch 7368
Loss = 2.0278e-02, PNorm = 774.5242, GNorm = 1.5983, lr_0 = 9.9489e-04
Validation auc = 0.687677
Epoch 7369
Loss = 3.6183e-02, PNorm = 774.5540, GNorm = 1.5916, lr_0 = 9.9489e-04
Loss = 4.8426e-02, PNorm = 774.5889, GNorm = 3.4546, lr_0 = 9.9489e-04
Validation auc = 0.685683
Epoch 7370
Loss = 2.5711e+00, PNorm = 774.6430, GNorm = 1.1694, lr_0 = 9.9489e-04
Validation auc = 0.683887
Epoch 7371
Loss = 1.7693e-01, PNorm = 774.7954, GNorm = 15.1759, lr_0 = 9.9489e-04
Validation auc = 0.678427
Epoch 7372
Loss = 9.3827e-02, PNorm = 774.9180, GNorm = 1.1105, lr_0 = 9.9489e-04
Validation auc = 0.687036
Epoch 7373
Loss = 6.5315e-02, PNorm = 775.0001, GNorm = 5.4432, lr_0 = 9.9489e-04
Validation auc = 0.697977
Epoch 7374
Loss = 1.1351e-01, PNorm = 775.0636, GNorm = 4.4835, lr_0 = 9.9489e-04
Validation auc = 0.692449
Epoch 7375
Loss = 8.1408e-02, PNorm = 775.1291, GNorm = 3.9827, lr_0 = 9.9489e-04
Validation auc = 0.697189
Epoch 7376
Loss = 3.7790e-02, PNorm = 775.1957, GNorm = 3.2461, lr_0 = 9.9489e-04
Validation auc = 0.703664
Epoch 7377
Loss = 8.3108e-02, PNorm = 775.2656, GNorm = 1.1133, lr_0 = 9.9489e-04
Validation auc = 0.702044
Epoch 7378
Loss = 8.1962e-02, PNorm = 775.3322, GNorm = 1.3329, lr_0 = 9.9489e-04
Validation auc = 0.703228
Epoch 7379
Loss = 1.1321e-02, PNorm = 775.3925, GNorm = 0.7555, lr_0 = 9.9489e-04
Loss = 5.6761e-02, PNorm = 775.4528, GNorm = 4.6301, lr_0 = 9.9488e-04
Validation auc = 0.689044
Epoch 7380
Loss = 5.7014e-02, PNorm = 775.5125, GNorm = 0.1423, lr_0 = 9.9488e-04
Validation auc = 0.674839
Epoch 7381
Loss = 5.8144e-02, PNorm = 775.5596, GNorm = 0.5327, lr_0 = 9.9488e-04
Validation auc = 0.666040
Epoch 7382
Loss = 3.2787e-02, PNorm = 775.5913, GNorm = 1.4832, lr_0 = 9.9488e-04
Validation auc = 0.659023
Epoch 7383
Loss = 4.7081e-02, PNorm = 775.6218, GNorm = 6.7815, lr_0 = 9.9488e-04
Validation auc = 0.656838
Epoch 7384
Loss = 6.0255e-02, PNorm = 775.6598, GNorm = 1.6655, lr_0 = 9.9488e-04
Validation auc = 0.656992
Epoch 7385
Loss = 6.8424e-02, PNorm = 775.7011, GNorm = 0.2140, lr_0 = 9.9488e-04
Validation auc = 0.657133
Epoch 7386
Loss = 3.1959e-02, PNorm = 775.7495, GNorm = 1.3044, lr_0 = 9.9488e-04
Validation auc = 0.659226
Epoch 7387
Loss = 3.3389e-02, PNorm = 775.7852, GNorm = 2.9170, lr_0 = 9.9488e-04
Validation auc = 0.661130
Epoch 7388
Loss = 5.3814e-02, PNorm = 775.8088, GNorm = 0.9680, lr_0 = 9.9488e-04
Validation auc = 0.664363
Epoch 7389
Loss = 5.8384e-02, PNorm = 775.8337, GNorm = 2.7483, lr_0 = 9.9488e-04
Loss = 4.5937e-02, PNorm = 775.8602, GNorm = 0.4012, lr_0 = 9.9488e-04
Validation auc = 0.657487
Epoch 7390
Loss = 4.1049e-02, PNorm = 775.8857, GNorm = 4.8729, lr_0 = 9.9488e-04
Validation auc = 0.652415
Epoch 7391
Loss = 4.6089e-02, PNorm = 775.9140, GNorm = 11.1454, lr_0 = 9.9488e-04
Validation auc = 0.650514
Epoch 7392
Loss = 5.4427e+00, PNorm = 775.9854, GNorm = 1.8396, lr_0 = 9.9487e-04
Validation auc = 0.660027
Epoch 7393
Loss = 1.1654e-01, PNorm = 776.1534, GNorm = 6.0344, lr_0 = 9.9487e-04
Validation auc = 0.676083
Epoch 7394
Loss = 2.1286e-01, PNorm = 776.2835, GNorm = 5.0646, lr_0 = 9.9487e-04
Validation auc = 0.666936
Epoch 7395
Loss = 2.7407e-01, PNorm = 776.4118, GNorm = 8.6212, lr_0 = 9.9487e-04
Validation auc = 0.662429
Epoch 7396
Loss = 1.4096e-01, PNorm = 776.5139, GNorm = 2.3538, lr_0 = 9.9487e-04
Validation auc = 0.659233
Epoch 7397
Loss = 5.1511e-02, PNorm = 776.5895, GNorm = 1.4645, lr_0 = 9.9487e-04
Validation auc = 0.661531
Epoch 7398
Loss = 1.6870e-01, PNorm = 776.6448, GNorm = 14.8078, lr_0 = 9.9487e-04
Validation auc = 0.666887
Epoch 7399
Loss = 2.0349e-02, PNorm = 776.7027, GNorm = 0.9352, lr_0 = 9.9487e-04
Loss = 7.4245e-01, PNorm = 776.8058, GNorm = 1.6644, lr_0 = 9.9487e-04
Validation auc = 0.666564
Epoch 7400
Loss = 9.6115e-02, PNorm = 776.9347, GNorm = 2.5658, lr_0 = 9.9487e-04
Validation auc = 0.658869
Epoch 7401
Loss = 7.1891e-02, PNorm = 777.0177, GNorm = 2.2808, lr_0 = 9.9487e-04
Validation auc = 0.654370
Epoch 7402
Loss = 1.4030e-01, PNorm = 777.1769, GNorm = 8.6745, lr_0 = 9.9487e-04
Validation auc = 0.667722
Epoch 7403
Loss = 1.4743e-01, PNorm = 777.3269, GNorm = 3.7618, lr_0 = 9.9487e-04
Validation auc = 0.668512
Epoch 7404
Loss = 1.5712e-01, PNorm = 777.4418, GNorm = 1.7908, lr_0 = 9.9487e-04
Validation auc = 0.669496
Epoch 7405
Loss = 1.0917e-01, PNorm = 777.5451, GNorm = 3.1115, lr_0 = 9.9487e-04
Validation auc = 0.674374
Epoch 7406
Loss = 7.0564e-02, PNorm = 777.6322, GNorm = 2.7617, lr_0 = 9.9486e-04
Validation auc = 0.674207
Epoch 7407
Loss = 1.0481e-01, PNorm = 777.7042, GNorm = 3.3538, lr_0 = 9.9486e-04
Validation auc = 0.683673
Epoch 7408
Loss = 9.5993e-02, PNorm = 777.7730, GNorm = 3.2879, lr_0 = 9.9486e-04
Validation auc = 0.688640
Epoch 7409
Loss = 1.7024e-01, PNorm = 777.8378, GNorm = 4.3360, lr_0 = 9.9486e-04
Loss = 8.1817e-02, PNorm = 777.8921, GNorm = 2.6107, lr_0 = 9.9486e-04
Validation auc = 0.682181
Epoch 7410
Loss = 1.2065e-01, PNorm = 777.9479, GNorm = 6.5006, lr_0 = 9.9486e-04
Validation auc = 0.676914
Epoch 7411
Loss = 4.2516e-02, PNorm = 778.0052, GNorm = 0.7039, lr_0 = 9.9486e-04
Validation auc = 0.671341
Epoch 7412
Loss = 7.4633e-02, PNorm = 778.0517, GNorm = 5.0234, lr_0 = 9.9486e-04
Validation auc = 0.670391
Epoch 7413
Loss = 7.0013e-02, PNorm = 778.0970, GNorm = 0.7411, lr_0 = 9.9486e-04
Validation auc = 0.670414
Epoch 7414
Loss = 8.5879e-02, PNorm = 778.1471, GNorm = 3.6798, lr_0 = 9.9486e-04
Validation auc = 0.668671
Epoch 7415
Loss = 9.3299e-02, PNorm = 778.2035, GNorm = 3.4221, lr_0 = 9.9486e-04
Validation auc = 0.666990
Epoch 7416
Loss = 1.5185e-01, PNorm = 778.2618, GNorm = 1.7544, lr_0 = 9.9486e-04
Validation auc = 0.670514
Epoch 7417
Loss = 1.2206e-01, PNorm = 778.3431, GNorm = 2.6093, lr_0 = 9.9486e-04
Validation auc = 0.675151
Epoch 7418
Loss = 4.3555e-02, PNorm = 778.4224, GNorm = 1.9030, lr_0 = 9.9486e-04
Validation auc = 0.675443
Epoch 7419
Loss = 4.1230e-02, PNorm = 778.4811, GNorm = 1.3087, lr_0 = 9.9485e-04
Loss = 7.1958e-02, PNorm = 778.5247, GNorm = 3.6054, lr_0 = 9.9485e-04
Validation auc = 0.683163
Epoch 7420
Loss = 3.8524e-02, PNorm = 778.5672, GNorm = 2.8517, lr_0 = 9.9485e-04
Validation auc = 0.687761
Epoch 7421
Loss = 5.7957e-02, PNorm = 778.6046, GNorm = 1.2814, lr_0 = 9.9485e-04
Validation auc = 0.690986
Epoch 7422
Loss = 3.7165e-02, PNorm = 778.6375, GNorm = 1.0518, lr_0 = 9.9485e-04
Validation auc = 0.690322
Epoch 7423
Loss = 3.8200e-02, PNorm = 778.6637, GNorm = 0.7919, lr_0 = 9.9485e-04
Validation auc = 0.687376
Epoch 7424
Loss = 4.9312e-02, PNorm = 778.6924, GNorm = 2.3810, lr_0 = 9.9485e-04
Validation auc = 0.687794
Epoch 7425
Loss = 2.8569e-02, PNorm = 778.7298, GNorm = 0.7351, lr_0 = 9.9485e-04
Validation auc = 0.681615
Epoch 7426
Loss = 6.7774e-02, PNorm = 778.7658, GNorm = 4.3847, lr_0 = 9.9485e-04
Validation auc = 0.684011
Epoch 7427
Loss = 7.4771e-02, PNorm = 778.8054, GNorm = 2.6556, lr_0 = 9.9485e-04
Validation auc = 0.686469
Epoch 7428
Loss = 2.2810e-02, PNorm = 778.8438, GNorm = 1.1160, lr_0 = 9.9485e-04
Validation auc = 0.679399
Epoch 7429
Loss = 1.6015e-01, PNorm = 778.8800, GNorm = 3.9277, lr_0 = 9.9485e-04
Loss = 8.0914e-02, PNorm = 778.9447, GNorm = 0.6205, lr_0 = 9.9485e-04
Validation auc = 0.676557
Epoch 7430
Loss = 6.6098e-02, PNorm = 778.9971, GNorm = 0.8165, lr_0 = 9.9485e-04
Validation auc = 0.678801
Epoch 7431
Loss = 4.5332e-02, PNorm = 779.0368, GNorm = 2.3106, lr_0 = 9.9485e-04
Validation auc = 0.677677
Epoch 7432
Loss = 4.5798e-01, PNorm = 779.0782, GNorm = 2.2394, lr_0 = 9.9484e-04
Validation auc = 0.684037
Epoch 7433
Loss = 6.2218e-02, PNorm = 779.1858, GNorm = 2.7497, lr_0 = 9.9484e-04
Validation auc = 0.688232
Epoch 7434
Loss = 1.1325e-01, PNorm = 779.2777, GNorm = 2.7606, lr_0 = 9.9484e-04
Validation auc = 0.689658
Epoch 7435
Loss = 1.0088e-01, PNorm = 779.3593, GNorm = 1.7190, lr_0 = 9.9484e-04
Validation auc = 0.687409
Epoch 7436
Loss = 6.1816e-02, PNorm = 779.4331, GNorm = 2.1528, lr_0 = 9.9484e-04
Validation auc = 0.679969
Epoch 7437
Loss = 6.0065e-02, PNorm = 779.4918, GNorm = 1.4967, lr_0 = 9.9484e-04
Validation auc = 0.680097
Epoch 7438
Loss = 3.6382e-02, PNorm = 779.5422, GNorm = 1.3283, lr_0 = 9.9484e-04
Validation auc = 0.681303
Epoch 7439
Loss = 9.4205e-02, PNorm = 779.5921, GNorm = 3.5985, lr_0 = 9.9484e-04
Loss = 3.8433e-02, PNorm = 779.6422, GNorm = 1.4413, lr_0 = 9.9484e-04
Validation auc = 0.679869
Epoch 7440
Loss = 1.1170e-01, PNorm = 779.6863, GNorm = 1.9543, lr_0 = 9.9484e-04
Validation auc = 0.680661
Epoch 7441
Loss = 1.2173e-01, PNorm = 779.7430, GNorm = 3.9146, lr_0 = 9.9484e-04
Validation auc = 0.686676
Epoch 7442
Loss = 1.1455e-01, PNorm = 779.8062, GNorm = 7.8139, lr_0 = 9.9484e-04
Validation auc = 0.684874
Epoch 7443
Loss = 4.5921e-02, PNorm = 779.8689, GNorm = 1.6229, lr_0 = 9.9484e-04
Validation auc = 0.680181
Epoch 7444
Loss = 1.2842e-01, PNorm = 779.9183, GNorm = 0.5402, lr_0 = 9.9484e-04
Validation auc = 0.676103
Epoch 7445
Loss = 7.6711e-02, PNorm = 779.9685, GNorm = 2.8418, lr_0 = 9.9484e-04
Validation auc = 0.670700
Epoch 7446
Loss = 2.8478e-02, PNorm = 780.0157, GNorm = 1.2625, lr_0 = 9.9483e-04
Validation auc = 0.667602
Epoch 7447
Loss = 1.2395e-01, PNorm = 780.0563, GNorm = 1.4510, lr_0 = 9.9483e-04
Validation auc = 0.666623
Epoch 7448
Loss = 4.8948e-02, PNorm = 780.0985, GNorm = 2.9229, lr_0 = 9.9483e-04
Validation auc = 0.664510
Epoch 7449
Loss = 3.6118e-02, PNorm = 780.1368, GNorm = 3.3605, lr_0 = 9.9483e-04
Loss = 4.0575e-02, PNorm = 780.1737, GNorm = 2.1194, lr_0 = 9.9483e-04
Validation auc = 0.658560
Epoch 7450
Loss = 7.5221e-02, PNorm = 780.2107, GNorm = 0.8127, lr_0 = 9.9483e-04
Validation auc = 0.659176
Epoch 7451
Loss = 9.0299e-02, PNorm = 780.2566, GNorm = 1.8660, lr_0 = 9.9483e-04
Validation auc = 0.658679
Epoch 7452
Loss = 4.2812e-02, PNorm = 780.3097, GNorm = 0.8583, lr_0 = 9.9483e-04
Validation auc = 0.667641
Epoch 7453
Loss = 1.0864e-01, PNorm = 780.3568, GNorm = 1.7404, lr_0 = 9.9483e-04
Validation auc = 0.675789
Epoch 7454
Loss = 6.9529e-02, PNorm = 780.4103, GNorm = 0.5594, lr_0 = 9.9483e-04
Validation auc = 0.676852
Epoch 7455
Loss = 3.5276e-02, PNorm = 780.4570, GNorm = 2.7459, lr_0 = 9.9483e-04
Validation auc = 0.679310
Epoch 7456
Loss = 5.5703e-02, PNorm = 780.4966, GNorm = 1.2521, lr_0 = 9.9483e-04
Validation auc = 0.678418
Epoch 7457
Loss = 9.0069e-02, PNorm = 780.5300, GNorm = 0.4412, lr_0 = 9.9483e-04
Validation auc = 0.677102
Epoch 7458
Loss = 4.0098e-02, PNorm = 780.5660, GNorm = 1.5366, lr_0 = 9.9483e-04
Validation auc = 0.681438
Epoch 7459
Loss = 1.4552e-01, PNorm = 780.6006, GNorm = 3.2423, lr_0 = 9.9482e-04
Loss = 4.0314e-02, PNorm = 780.6345, GNorm = 1.1673, lr_0 = 9.9482e-04
Validation auc = 0.684046
Epoch 7460
Loss = 6.2189e-02, PNorm = 780.6628, GNorm = 1.6875, lr_0 = 9.9482e-04
Validation auc = 0.680342
Epoch 7461
Loss = 3.5039e-02, PNorm = 780.6964, GNorm = 0.4059, lr_0 = 9.9482e-04
Validation auc = 0.677750
Epoch 7462
Loss = 7.6484e-02, PNorm = 780.7340, GNorm = 1.2054, lr_0 = 9.9482e-04
Validation auc = 0.685088
Epoch 7463
Loss = 5.1950e-02, PNorm = 780.7743, GNorm = 5.5185, lr_0 = 9.9482e-04
Validation auc = 0.688330
Epoch 7464
Loss = 1.9485e-01, PNorm = 780.8187, GNorm = 3.4488, lr_0 = 9.9482e-04
Validation auc = 0.684338
Epoch 7465
Loss = 5.0408e-02, PNorm = 780.8769, GNorm = 0.5506, lr_0 = 9.9482e-04
Validation auc = 0.683990
Epoch 7466
Loss = 4.3278e-02, PNorm = 780.9239, GNorm = 1.1613, lr_0 = 9.9482e-04
Validation auc = 0.685792
Epoch 7467
Loss = 5.0607e-02, PNorm = 780.9666, GNorm = 1.6931, lr_0 = 9.9482e-04
Validation auc = 0.681678
Epoch 7468
Loss = 7.5756e-02, PNorm = 781.0167, GNorm = 3.8646, lr_0 = 9.9482e-04
Validation auc = 0.680915
Epoch 7469
Loss = 8.9839e-02, PNorm = 781.0570, GNorm = 4.3157, lr_0 = 9.9482e-04
Loss = 3.4772e-02, PNorm = 781.0931, GNorm = 2.3036, lr_0 = 9.9482e-04
Validation auc = 0.681740
Epoch 7470
Loss = 5.0334e-02, PNorm = 781.1257, GNorm = 0.2174, lr_0 = 9.9482e-04
Validation auc = 0.684633
Epoch 7471
Loss = 6.1580e-02, PNorm = 781.1567, GNorm = 1.8336, lr_0 = 9.9482e-04
Validation auc = 0.690122
Epoch 7472
Loss = 8.3758e-02, PNorm = 781.1884, GNorm = 2.3362, lr_0 = 9.9481e-04
Validation auc = 0.688457
Epoch 7473
Loss = 7.9229e-02, PNorm = 781.2189, GNorm = 2.3207, lr_0 = 9.9481e-04
Validation auc = 0.689289
Epoch 7474
Loss = 4.3372e-02, PNorm = 781.2534, GNorm = 14.0762, lr_0 = 9.9481e-04
Validation auc = 0.690201
Epoch 7475
Loss = 3.7923e-02, PNorm = 781.2906, GNorm = 0.6962, lr_0 = 9.9481e-04
Validation auc = 0.686166
Epoch 7476
Loss = 6.0902e-03, PNorm = 781.3245, GNorm = 0.6704, lr_0 = 9.9481e-04
Validation auc = 0.687753
Epoch 7477
Loss = 3.4012e-02, PNorm = 781.3539, GNorm = 0.9862, lr_0 = 9.9481e-04
Validation auc = 0.688575
Epoch 7478
Loss = 4.4300e-02, PNorm = 781.3838, GNorm = 2.1044, lr_0 = 9.9481e-04
Validation auc = 0.687382
Epoch 7479
Loss = 9.4434e-03, PNorm = 781.4066, GNorm = 0.6426, lr_0 = 9.9481e-04
Loss = 3.3916e-02, PNorm = 781.4286, GNorm = 0.6487, lr_0 = 9.9481e-04
Validation auc = 0.685888
Epoch 7480
Loss = 1.9155e-02, PNorm = 781.4478, GNorm = 2.5759, lr_0 = 9.9481e-04
Validation auc = 0.687920
Epoch 7481
Loss = 7.3933e-02, PNorm = 781.4716, GNorm = 3.7593, lr_0 = 9.9481e-04
Validation auc = 0.685989
Epoch 7482
Loss = 6.8667e-02, PNorm = 781.5022, GNorm = 1.4769, lr_0 = 9.9481e-04
Validation auc = 0.673842
Epoch 7483
Loss = 3.5118e-02, PNorm = 781.5354, GNorm = 5.6169, lr_0 = 9.9481e-04
Validation auc = 0.670990
Epoch 7484
Loss = 5.1143e-02, PNorm = 781.5676, GNorm = 0.7179, lr_0 = 9.9481e-04
Validation auc = 0.673909
Epoch 7485
Loss = 1.8885e-02, PNorm = 781.5968, GNorm = 2.4877, lr_0 = 9.9480e-04
Validation auc = 0.674278
Epoch 7486
Loss = 1.1669e-01, PNorm = 781.6240, GNorm = 1.3427, lr_0 = 9.9480e-04
Validation auc = 0.669283
Epoch 7487
Loss = 3.6389e-02, PNorm = 781.6683, GNorm = 1.2852, lr_0 = 9.9480e-04
Validation auc = 0.673829
Epoch 7488
Loss = 4.4856e-03, PNorm = 781.7118, GNorm = 0.1257, lr_0 = 9.9480e-04
Validation auc = 0.679758
Epoch 7489
Loss = 1.1957e-03, PNorm = 781.7424, GNorm = 0.1046, lr_0 = 9.9480e-04
Loss = 2.4460e-02, PNorm = 781.7688, GNorm = 1.8028, lr_0 = 9.9480e-04
Validation auc = 0.685319
Epoch 7490
Loss = 4.9437e-02, PNorm = 781.7897, GNorm = 0.6631, lr_0 = 9.9480e-04
Validation auc = 0.685491
Epoch 7491
Loss = 1.3599e-01, PNorm = 781.8237, GNorm = 14.7798, lr_0 = 9.9480e-04
Validation auc = 0.683837
Epoch 7492
Loss = 1.3655e-01, PNorm = 781.8751, GNorm = 1.6655, lr_0 = 9.9480e-04
Validation auc = 0.680024
Epoch 7493
Loss = 4.8774e-02, PNorm = 781.9260, GNorm = 5.2166, lr_0 = 9.9480e-04
Validation auc = 0.674787
Epoch 7494
Loss = 4.2609e-02, PNorm = 781.9629, GNorm = 1.0191, lr_0 = 9.9480e-04
Validation auc = 0.665013
Epoch 7495
Loss = 3.3106e-02, PNorm = 781.9972, GNorm = 2.2084, lr_0 = 9.9480e-04
Validation auc = 0.659967
Epoch 7496
Loss = 5.3568e-02, PNorm = 782.0346, GNorm = 1.4440, lr_0 = 9.9480e-04
Validation auc = 0.664331
Epoch 7497
Loss = 3.8932e-02, PNorm = 782.0703, GNorm = 0.8230, lr_0 = 9.9480e-04
Validation auc = 0.671054
Epoch 7498
Loss = 1.4539e-01, PNorm = 782.1021, GNorm = 4.1759, lr_0 = 9.9480e-04
Validation auc = 0.675355
Epoch 7499
Loss = 1.9651e-02, PNorm = 782.1336, GNorm = 0.9101, lr_0 = 9.9479e-04
Loss = 7.6862e-02, PNorm = 782.1763, GNorm = 2.3683, lr_0 = 9.9479e-04
Validation auc = 0.675987
Epoch 7500
Loss = 4.0546e-02, PNorm = 782.2195, GNorm = 0.9568, lr_0 = 9.9479e-04
Validation auc = 0.676759
Epoch 7501
Loss = 1.7496e-01, PNorm = 782.2522, GNorm = 1.8283, lr_0 = 9.9479e-04
Validation auc = 0.688938
Epoch 7502
Loss = 5.5219e-01, PNorm = 782.3117, GNorm = 2.3758, lr_0 = 9.9479e-04
Validation auc = 0.700937
Epoch 7503
Loss = 6.4926e-02, PNorm = 782.4210, GNorm = 1.9962, lr_0 = 9.9479e-04
Validation auc = 0.704212
Epoch 7504
Loss = 5.3584e-02, PNorm = 782.4969, GNorm = 1.1893, lr_0 = 9.9479e-04
Validation auc = 0.703021
Epoch 7505
Loss = 4.7831e-02, PNorm = 782.5546, GNorm = 1.4022, lr_0 = 9.9479e-04
Validation auc = 0.699250
Epoch 7506
Loss = 5.0131e-02, PNorm = 782.6038, GNorm = 1.3281, lr_0 = 9.9479e-04
Validation auc = 0.697366
Epoch 7507
Loss = 5.0378e-02, PNorm = 782.6447, GNorm = 1.0940, lr_0 = 9.9479e-04
Validation auc = 0.691195
Epoch 7508
Loss = 7.0632e-02, PNorm = 782.6864, GNorm = 0.6260, lr_0 = 9.9479e-04
Validation auc = 0.692278
Epoch 7509
Loss = 1.0757e-01, PNorm = 782.7170, GNorm = 3.9938, lr_0 = 9.9479e-04
Loss = 4.2353e-02, PNorm = 782.7449, GNorm = 1.0233, lr_0 = 9.9479e-04
Validation auc = 0.697298
Epoch 7510
Loss = 8.8452e-02, PNorm = 782.7925, GNorm = 1.7918, lr_0 = 9.9479e-04
Validation auc = 0.702474
Epoch 7511
Loss = 4.3437e-02, PNorm = 782.8393, GNorm = 1.1999, lr_0 = 9.9479e-04
Validation auc = 0.701354
Epoch 7512
Loss = 8.2690e-02, PNorm = 782.8817, GNorm = 4.4661, lr_0 = 9.9478e-04
Validation auc = 0.699243
Epoch 7513
Loss = 5.9783e-02, PNorm = 782.9251, GNorm = 1.3318, lr_0 = 9.9478e-04
Validation auc = 0.698569
Epoch 7514
Loss = 3.4201e-02, PNorm = 782.9649, GNorm = 1.3332, lr_0 = 9.9478e-04
Validation auc = 0.701358
Epoch 7515
Loss = 9.7105e-02, PNorm = 782.9986, GNorm = 4.0628, lr_0 = 9.9478e-04
Validation auc = 0.701278
Epoch 7516
Loss = 6.6555e-02, PNorm = 783.0340, GNorm = 4.5241, lr_0 = 9.9478e-04
Validation auc = 0.704562
Epoch 7517
Loss = 1.4545e-02, PNorm = 783.0728, GNorm = 1.4555, lr_0 = 9.9478e-04
Validation auc = 0.706393
Epoch 7518
Loss = 9.7747e-02, PNorm = 783.1060, GNorm = 2.2631, lr_0 = 9.9478e-04
Validation auc = 0.709981
Epoch 7519
Loss = 4.7925e-03, PNorm = 783.1315, GNorm = 0.3504, lr_0 = 9.9478e-04
Loss = 2.6634e-02, PNorm = 783.1527, GNorm = 0.7965, lr_0 = 9.9478e-04
Validation auc = 0.709769
Epoch 7520
Loss = 7.4134e-02, PNorm = 783.1827, GNorm = 0.3667, lr_0 = 9.9478e-04
Validation auc = 0.704480
Epoch 7521
Loss = 4.1095e-02, PNorm = 783.2218, GNorm = 0.5795, lr_0 = 9.9478e-04
Validation auc = 0.704219
Epoch 7522
Loss = 4.1207e-02, PNorm = 783.2516, GNorm = 3.9372, lr_0 = 9.9478e-04
Validation auc = 0.699861
Epoch 7523
Loss = 4.3334e-02, PNorm = 783.2785, GNorm = 1.7102, lr_0 = 9.9478e-04
Validation auc = 0.702098
Epoch 7524
Loss = 3.8277e-02, PNorm = 783.3055, GNorm = 0.5129, lr_0 = 9.9478e-04
Validation auc = 0.706228
Epoch 7525
Loss = 4.9829e-02, PNorm = 783.3275, GNorm = 1.2015, lr_0 = 9.9477e-04
Validation auc = 0.710057
Epoch 7526
Loss = 6.2398e-02, PNorm = 783.3507, GNorm = 6.7074, lr_0 = 9.9477e-04
Validation auc = 0.711864
Epoch 7527
Loss = 2.5188e-02, PNorm = 783.3748, GNorm = 0.3398, lr_0 = 9.9477e-04
Validation auc = 0.715278
Epoch 7528
Loss = 1.0684e-01, PNorm = 783.3994, GNorm = 2.6109, lr_0 = 9.9477e-04
Validation auc = 0.714946
Epoch 7529
Loss = 2.0328e-02, PNorm = 783.4222, GNorm = 1.8190, lr_0 = 9.9477e-04
Loss = 2.9936e-02, PNorm = 783.4451, GNorm = 2.1184, lr_0 = 9.9477e-04
Validation auc = 0.712751
Epoch 7530
Loss = 4.9948e-02, PNorm = 783.4760, GNorm = 1.1380, lr_0 = 9.9477e-04
Validation auc = 0.709564
Epoch 7531
Loss = 3.8445e-02, PNorm = 783.4988, GNorm = 0.5995, lr_0 = 9.9477e-04
Validation auc = 0.709842
Epoch 7532
Loss = 2.3511e-02, PNorm = 783.5198, GNorm = 0.4052, lr_0 = 9.9477e-04
Validation auc = 0.709506
Epoch 7533
Loss = 4.9995e-02, PNorm = 783.5395, GNorm = 0.3234, lr_0 = 9.9477e-04
Validation auc = 0.711295
Epoch 7534
Loss = 3.4323e-02, PNorm = 783.5573, GNorm = 1.3684, lr_0 = 9.9477e-04
Validation auc = 0.706370
Epoch 7535
Loss = 7.1710e-02, PNorm = 783.5768, GNorm = 7.1695, lr_0 = 9.9477e-04
Validation auc = 0.700963
Epoch 7536
Loss = 9.5632e-02, PNorm = 783.6057, GNorm = 0.3900, lr_0 = 9.9477e-04
Validation auc = 0.698891
Epoch 7537
Loss = 5.8864e-02, PNorm = 783.6386, GNorm = 2.6685, lr_0 = 9.9477e-04
Validation auc = 0.702667
Epoch 7538
Loss = 5.8300e-02, PNorm = 783.6749, GNorm = 2.4770, lr_0 = 9.9477e-04
Validation auc = 0.698371
Epoch 7539
Loss = 1.0070e-02, PNorm = 783.7073, GNorm = 0.2417, lr_0 = 9.9476e-04
Loss = 2.4967e-02, PNorm = 783.7349, GNorm = 0.7047, lr_0 = 9.9476e-04
Validation auc = 0.698538
Epoch 7540
Loss = 6.6596e-02, PNorm = 783.7632, GNorm = 2.5823, lr_0 = 9.9476e-04
Validation auc = 0.699755
Epoch 7541
Loss = 3.4918e-02, PNorm = 783.7941, GNorm = 0.5695, lr_0 = 9.9476e-04
Validation auc = 0.700142
Epoch 7542
Loss = 2.3551e-02, PNorm = 783.8243, GNorm = 1.3572, lr_0 = 9.9476e-04
Validation auc = 0.700636
Epoch 7543
Loss = 3.7822e-02, PNorm = 783.8462, GNorm = 0.5088, lr_0 = 9.9476e-04
Validation auc = 0.703498
Epoch 7544
Loss = 1.0519e-02, PNorm = 783.8682, GNorm = 1.3405, lr_0 = 9.9476e-04
Validation auc = 0.703883
Epoch 7545
Loss = 4.5474e-02, PNorm = 783.8867, GNorm = 0.2819, lr_0 = 9.9476e-04
Validation auc = 0.700169
Epoch 7546
Loss = 3.2436e-02, PNorm = 783.9079, GNorm = 1.1230, lr_0 = 9.9476e-04
Validation auc = 0.695764
Epoch 7547
Loss = 1.9113e-02, PNorm = 783.9333, GNorm = 0.1853, lr_0 = 9.9476e-04
Validation auc = 0.690878
Epoch 7548
Loss = 5.5584e-02, PNorm = 783.9591, GNorm = 2.7191, lr_0 = 9.9476e-04
Validation auc = 0.690503
Epoch 7549
Loss = 3.9732e-02, PNorm = 783.9970, GNorm = 1.7776, lr_0 = 9.9476e-04
Loss = 4.3743e-02, PNorm = 784.0303, GNorm = 1.9237, lr_0 = 9.9476e-04
Validation auc = 0.691485
Epoch 7550
Loss = 1.8881e-02, PNorm = 784.0528, GNorm = 0.5982, lr_0 = 9.9476e-04
Validation auc = 0.690189
Epoch 7551
Loss = 2.4183e-02, PNorm = 784.0715, GNorm = 0.5178, lr_0 = 9.9475e-04
Validation auc = 0.687309
Epoch 7552
Loss = 2.9141e-02, PNorm = 784.0993, GNorm = 0.5837, lr_0 = 9.9475e-04
Validation auc = 0.682541
Epoch 7553
Loss = 5.2086e-02, PNorm = 784.1240, GNorm = 2.3098, lr_0 = 9.9475e-04
Validation auc = 0.683463
Epoch 7554
Loss = 5.4425e-02, PNorm = 784.1522, GNorm = 0.9763, lr_0 = 9.9475e-04
Validation auc = 0.687765
Epoch 7555
Loss = 1.3798e-01, PNorm = 784.1912, GNorm = 1.6919, lr_0 = 9.9475e-04
Validation auc = 0.683192
Epoch 7556
Loss = 5.7884e-02, PNorm = 784.2443, GNorm = 0.4161, lr_0 = 9.9475e-04
Validation auc = 0.678886
Epoch 7557
Loss = 8.8884e-02, PNorm = 784.2881, GNorm = 2.5136, lr_0 = 9.9475e-04
Validation auc = 0.674300
Epoch 7558
Loss = 5.8419e-02, PNorm = 784.3206, GNorm = 1.9631, lr_0 = 9.9475e-04
Validation auc = 0.672623
Epoch 7559
Loss = 2.1430e-03, PNorm = 784.3482, GNorm = 0.1751, lr_0 = 9.9475e-04
Loss = 4.8522e-02, PNorm = 784.3715, GNorm = 2.2845, lr_0 = 9.9475e-04
Validation auc = 0.673806
Epoch 7560
Loss = 4.4555e-02, PNorm = 784.3975, GNorm = 2.4826, lr_0 = 9.9475e-04
Validation auc = 0.676354
Epoch 7561
Loss = 2.9604e-02, PNorm = 784.4239, GNorm = 4.8574, lr_0 = 9.9475e-04
Validation auc = 0.683479
Epoch 7562
Loss = 8.1878e-02, PNorm = 784.4507, GNorm = 20.7355, lr_0 = 9.9475e-04
Validation auc = 0.693990
Epoch 7563
Loss = 3.0736e-02, PNorm = 784.4842, GNorm = 0.1533, lr_0 = 9.9475e-04
Validation auc = 0.698874
Epoch 7564
Loss = 3.3838e-02, PNorm = 784.5098, GNorm = 4.6696, lr_0 = 9.9475e-04
Validation auc = 0.697238
Epoch 7565
Loss = 8.5151e-02, PNorm = 784.5366, GNorm = 5.7379, lr_0 = 9.9474e-04
Validation auc = 0.703747
Epoch 7566
Loss = 4.5108e-02, PNorm = 784.5733, GNorm = 3.6221, lr_0 = 9.9474e-04
Validation auc = 0.706755
Epoch 7567
Loss = 1.1759e-01, PNorm = 784.6027, GNorm = 5.1457, lr_0 = 9.9474e-04
Validation auc = 0.701017
Epoch 7568
Loss = 1.1481e-01, PNorm = 784.6332, GNorm = 3.1673, lr_0 = 9.9474e-04
Validation auc = 0.700351
Epoch 7569
Loss = 3.4499e-03, PNorm = 784.6724, GNorm = 0.2504, lr_0 = 9.9474e-04
Loss = 3.1408e-02, PNorm = 784.7008, GNorm = 1.7765, lr_0 = 9.9474e-04
Validation auc = 0.701987
Epoch 7570
Loss = 4.5129e-02, PNorm = 784.7292, GNorm = 0.2548, lr_0 = 9.9474e-04
Validation auc = 0.702520
Epoch 7571
Loss = 2.8068e-02, PNorm = 784.7536, GNorm = 1.5001, lr_0 = 9.9474e-04
Validation auc = 0.703241
Epoch 7572
Loss = 2.0107e-02, PNorm = 784.7723, GNorm = 0.5790, lr_0 = 9.9474e-04
Validation auc = 0.704230
Epoch 7573
Loss = 2.9661e-02, PNorm = 784.7870, GNorm = 2.5539, lr_0 = 9.9474e-04
Validation auc = 0.704519
Epoch 7574
Loss = 5.4434e-02, PNorm = 784.8060, GNorm = 3.9380, lr_0 = 9.9474e-04
Validation auc = 0.704630
Epoch 7575
Loss = 2.2464e-02, PNorm = 784.8375, GNorm = 5.0003, lr_0 = 9.9474e-04
Validation auc = 0.705081
Epoch 7576
Loss = 4.2215e-02, PNorm = 784.8677, GNorm = 4.7081, lr_0 = 9.9474e-04
Validation auc = 0.706949
Epoch 7577
Loss = 3.7391e-02, PNorm = 784.8891, GNorm = 0.1661, lr_0 = 9.9474e-04
Validation auc = 0.707561
Epoch 7578
Loss = 7.9774e-03, PNorm = 784.9079, GNorm = 0.4406, lr_0 = 9.9474e-04
Validation auc = 0.702081
Epoch 7579
Loss = 2.3715e-03, PNorm = 784.9375, GNorm = 0.1661, lr_0 = 9.9473e-04
Loss = 4.8464e-02, PNorm = 784.9743, GNorm = 4.0012, lr_0 = 9.9473e-04
Validation auc = 0.693953
Epoch 7580
Loss = 3.6893e-02, PNorm = 785.0068, GNorm = 0.2997, lr_0 = 9.9473e-04
Validation auc = 0.689402
Epoch 7581
Loss = 4.0050e-02, PNorm = 785.0289, GNorm = 2.6177, lr_0 = 9.9473e-04
Validation auc = 0.687292
Epoch 7582
Loss = 1.0878e-01, PNorm = 785.0482, GNorm = 9.2428, lr_0 = 9.9473e-04
Validation auc = 0.685749
Epoch 7583
Loss = 1.3773e-01, PNorm = 785.0787, GNorm = 10.0348, lr_0 = 9.9473e-04
Validation auc = 0.686874
Epoch 7584
Loss = 5.5179e-02, PNorm = 785.1437, GNorm = 2.1370, lr_0 = 9.9473e-04
Validation auc = 0.688517
Epoch 7585
Loss = 2.1887e-02, PNorm = 785.1945, GNorm = 0.7189, lr_0 = 9.9473e-04
Validation auc = 0.690418
Epoch 7586
Loss = 3.2998e-02, PNorm = 785.2265, GNorm = 0.4622, lr_0 = 9.9473e-04
Validation auc = 0.693654
Epoch 7587
Loss = 9.1476e-02, PNorm = 785.2488, GNorm = 0.2558, lr_0 = 9.9473e-04
Validation auc = 0.696566
Epoch 7588
Loss = 2.2496e-02, PNorm = 785.2739, GNorm = 0.1832, lr_0 = 9.9473e-04
Validation auc = 0.697907
Epoch 7589
Loss = 7.7238e-03, PNorm = 785.3024, GNorm = 0.1134, lr_0 = 9.9473e-04
Loss = 5.0272e-02, PNorm = 785.3367, GNorm = 0.1882, lr_0 = 9.9473e-04
Validation auc = 0.701033
Epoch 7590
Loss = 4.5166e-02, PNorm = 785.3743, GNorm = 0.4568, lr_0 = 9.9473e-04
Validation auc = 0.697991
Epoch 7591
Loss = 4.1173e-02, PNorm = 785.4170, GNorm = 6.7905, lr_0 = 9.9472e-04
Validation auc = 0.683291
Epoch 7592
Loss = 1.9337e-02, PNorm = 785.4585, GNorm = 0.5351, lr_0 = 9.9472e-04
Validation auc = 0.678394
Epoch 7593
Loss = 3.3954e-02, PNorm = 785.4937, GNorm = 0.6292, lr_0 = 9.9472e-04
Validation auc = 0.679635
Epoch 7594
Loss = 4.7037e-02, PNorm = 785.5300, GNorm = 3.4881, lr_0 = 9.9472e-04
Validation auc = 0.679891
Epoch 7595
Loss = 4.7836e-02, PNorm = 785.5653, GNorm = 0.3270, lr_0 = 9.9472e-04
Validation auc = 0.683287
Epoch 7596
Loss = 1.9808e-01, PNorm = 785.6012, GNorm = 11.6482, lr_0 = 9.9472e-04
Validation auc = 0.692502
Epoch 7597
Loss = 9.3580e-01, PNorm = 785.6432, GNorm = 124.4649, lr_0 = 9.9472e-04
Validation auc = 0.695566
Epoch 7598
Loss = 3.1716e-02, PNorm = 785.7122, GNorm = 0.9635, lr_0 = 9.9472e-04
Validation auc = 0.693039
Epoch 7599
Loss = 5.1252e-02, PNorm = 785.7603, GNorm = 1.2615, lr_0 = 9.9472e-04
Loss = 6.0513e-02, PNorm = 785.7989, GNorm = 0.8098, lr_0 = 9.9472e-04
Validation auc = 0.696929
Epoch 7600
Loss = 4.1611e-02, PNorm = 785.8353, GNorm = 0.8480, lr_0 = 9.9472e-04
Validation auc = 0.701553
Epoch 7601
Loss = 2.9041e-02, PNorm = 785.8626, GNorm = 1.5473, lr_0 = 9.9472e-04
Validation auc = 0.704209
Epoch 7602
Loss = 1.9087e-02, PNorm = 785.8877, GNorm = 0.3721, lr_0 = 9.9472e-04
Validation auc = 0.706122
Epoch 7603
Loss = 5.2853e-02, PNorm = 785.9124, GNorm = 3.0845, lr_0 = 9.9472e-04
Validation auc = 0.698211
Epoch 7604
Loss = 5.4230e-02, PNorm = 785.9510, GNorm = 1.2339, lr_0 = 9.9472e-04
Validation auc = 0.690761
Epoch 7605
Loss = 2.8378e-02, PNorm = 785.9901, GNorm = 3.1975, lr_0 = 9.9471e-04
Validation auc = 0.693853
Epoch 7606
Loss = 3.6718e-02, PNorm = 786.0220, GNorm = 0.8484, lr_0 = 9.9471e-04
Validation auc = 0.699573
Epoch 7607
Loss = 1.1664e-01, PNorm = 786.0537, GNorm = 0.9130, lr_0 = 9.9471e-04
Validation auc = 0.701178
Epoch 7608
Loss = 1.8754e-02, PNorm = 786.0808, GNorm = 1.8643, lr_0 = 9.9471e-04
Validation auc = 0.697845
Epoch 7609
Loss = 2.3680e-01, PNorm = 786.1043, GNorm = 7.9679, lr_0 = 9.9471e-04
Loss = 3.2027e-02, PNorm = 786.1307, GNorm = 0.8072, lr_0 = 9.9471e-04
Validation auc = 0.696027
Epoch 7610
Loss = 2.6773e-02, PNorm = 786.1591, GNorm = 1.9231, lr_0 = 9.9471e-04
Validation auc = 0.692104
Epoch 7611
Loss = 6.1643e-02, PNorm = 786.1931, GNorm = 1.4979, lr_0 = 9.9471e-04
Validation auc = 0.686990
Epoch 7612
Loss = 5.3563e-02, PNorm = 786.2257, GNorm = 1.4006, lr_0 = 9.9471e-04
Validation auc = 0.688914
Epoch 7613
Loss = 3.1602e-02, PNorm = 786.2717, GNorm = 1.5857, lr_0 = 9.9471e-04
Validation auc = 0.687411
Epoch 7614
Loss = 2.0180e-02, PNorm = 786.3203, GNorm = 1.5041, lr_0 = 9.9471e-04
Validation auc = 0.685822
Epoch 7615
Loss = 1.0604e-01, PNorm = 786.3566, GNorm = 0.1216, lr_0 = 9.9471e-04
Validation auc = 0.687739
Epoch 7616
Loss = 1.2571e-02, PNorm = 786.3961, GNorm = 0.5205, lr_0 = 9.9471e-04
Validation auc = 0.690005
Epoch 7617
Loss = 3.8467e-02, PNorm = 786.4297, GNorm = 2.0602, lr_0 = 9.9471e-04
Validation auc = 0.690033
Epoch 7618
Loss = 4.8585e-02, PNorm = 786.4592, GNorm = 1.0093, lr_0 = 9.9470e-04
Validation auc = 0.693037
Epoch 7619
Loss = 1.2144e-02, PNorm = 786.4925, GNorm = 1.2780, lr_0 = 9.9470e-04
Loss = 2.1042e-02, PNorm = 786.5369, GNorm = 0.5523, lr_0 = 9.9470e-04
Validation auc = 0.693760
Epoch 7620
Loss = 3.0455e-02, PNorm = 786.5720, GNorm = 1.0675, lr_0 = 9.9470e-04
Validation auc = 0.694973
Epoch 7621
Loss = 3.1367e-02, PNorm = 786.6015, GNorm = 0.9399, lr_0 = 9.9470e-04
Validation auc = 0.697134
Epoch 7622
Loss = 3.1279e-02, PNorm = 786.6271, GNorm = 0.4804, lr_0 = 9.9470e-04
Validation auc = 0.698326
Epoch 7623
Loss = 4.1120e-02, PNorm = 786.6515, GNorm = 0.6968, lr_0 = 9.9470e-04
Validation auc = 0.701910
Epoch 7624
Loss = 1.2956e-01, PNorm = 786.7039, GNorm = 0.2849, lr_0 = 9.9470e-04
Validation auc = 0.701140
Epoch 7625
Loss = 7.5449e-02, PNorm = 786.7745, GNorm = 0.7429, lr_0 = 9.9470e-04
Validation auc = 0.698824
Epoch 7626
Loss = 1.1527e-01, PNorm = 786.8293, GNorm = 2.5183, lr_0 = 9.9470e-04
Validation auc = 0.702671
Epoch 7627
Loss = 2.6058e-02, PNorm = 786.8779, GNorm = 4.5822, lr_0 = 9.9470e-04
Validation auc = 0.705625
Epoch 7628
Loss = 3.4641e-02, PNorm = 786.9218, GNorm = 0.7523, lr_0 = 9.9470e-04
Validation auc = 0.701024
Epoch 7629
Loss = 2.5904e-03, PNorm = 786.9587, GNorm = 0.1473, lr_0 = 9.9470e-04
Loss = 5.6080e-02, PNorm = 786.9889, GNorm = 1.8728, lr_0 = 9.9470e-04
Validation auc = 0.697050
Epoch 7630
Loss = 6.5724e-02, PNorm = 787.0243, GNorm = 3.5427, lr_0 = 9.9470e-04
Validation auc = 0.696055
Epoch 7631
Loss = 5.1993e-02, PNorm = 787.0685, GNorm = 2.0871, lr_0 = 9.9469e-04
Validation auc = 0.694755
Epoch 7632
Loss = 6.2891e-02, PNorm = 787.1106, GNorm = 1.2403, lr_0 = 9.9469e-04
Validation auc = 0.690623
Epoch 7633
Loss = 1.0168e-01, PNorm = 787.1543, GNorm = 2.7539, lr_0 = 9.9469e-04
Validation auc = 0.696086
Epoch 7634
Loss = 4.5481e-02, PNorm = 787.1987, GNorm = 1.0230, lr_0 = 9.9469e-04
Validation auc = 0.699443
Epoch 7635
Loss = 3.9040e-02, PNorm = 787.2356, GNorm = 0.3731, lr_0 = 9.9469e-04
Validation auc = 0.695035
Epoch 7636
Loss = 3.0352e-02, PNorm = 787.2675, GNorm = 0.7174, lr_0 = 9.9469e-04
Validation auc = 0.694762
Epoch 7637
Loss = 2.5997e-02, PNorm = 787.2951, GNorm = 0.7403, lr_0 = 9.9469e-04
Validation auc = 0.698380
Epoch 7638
Loss = 6.3492e-02, PNorm = 787.3196, GNorm = 1.7795, lr_0 = 9.9469e-04
Validation auc = 0.697906
Epoch 7639
Loss = 2.2385e-02, PNorm = 787.3536, GNorm = 1.4649, lr_0 = 9.9469e-04
Loss = 4.6916e-02, PNorm = 787.3894, GNorm = 4.1967, lr_0 = 9.9469e-04
Validation auc = 0.691796
Epoch 7640
Loss = 4.5918e-01, PNorm = 787.4995, GNorm = 0.9542, lr_0 = 9.9469e-04
Validation auc = 0.675371
Epoch 7641
Loss = 1.0045e-01, PNorm = 787.6252, GNorm = 2.6336, lr_0 = 9.9469e-04
Validation auc = 0.673696
Epoch 7642
Loss = 5.1640e-02, PNorm = 787.7038, GNorm = 2.0996, lr_0 = 9.9469e-04
Validation auc = 0.679751
Epoch 7643
Loss = 5.5629e-02, PNorm = 787.7561, GNorm = 1.0509, lr_0 = 9.9469e-04
Validation auc = 0.692499
Epoch 7644
Loss = 9.3589e-02, PNorm = 787.8025, GNorm = 1.0824, lr_0 = 9.9469e-04
Validation auc = 0.692633
Epoch 7645
Loss = 7.5223e-02, PNorm = 787.8479, GNorm = 1.1754, lr_0 = 9.9468e-04
Validation auc = 0.693519
Epoch 7646
Loss = 8.2583e-02, PNorm = 787.9043, GNorm = 3.1069, lr_0 = 9.9468e-04
Validation auc = 0.699978
Epoch 7647
Loss = 3.8769e-02, PNorm = 787.9653, GNorm = 2.1247, lr_0 = 9.9468e-04
Validation auc = 0.701611
Epoch 7648
Loss = 2.7492e-02, PNorm = 788.0119, GNorm = 1.7931, lr_0 = 9.9468e-04
Validation auc = 0.699722
Epoch 7649
Loss = 3.6873e-02, PNorm = 788.0621, GNorm = 1.7980, lr_0 = 9.9468e-04
Loss = 4.1073e-02, PNorm = 788.1023, GNorm = 2.0999, lr_0 = 9.9468e-04
Validation auc = 0.700364
Epoch 7650
Loss = 3.4070e-02, PNorm = 788.1346, GNorm = 1.0681, lr_0 = 9.9468e-04
Validation auc = 0.700784
Epoch 7651
Loss = 8.8843e-02, PNorm = 788.1714, GNorm = 2.0060, lr_0 = 9.9468e-04
Validation auc = 0.699342
Epoch 7652
Loss = 9.0837e-02, PNorm = 788.2185, GNorm = 1.4498, lr_0 = 9.9468e-04
Validation auc = 0.694152
Epoch 7653
Loss = 6.3847e-02, PNorm = 788.2636, GNorm = 3.1729, lr_0 = 9.9468e-04
Validation auc = 0.693980
Epoch 7654
Loss = 4.6288e-02, PNorm = 788.3022, GNorm = 0.5826, lr_0 = 9.9468e-04
Validation auc = 0.691456
Epoch 7655
Loss = 6.9801e-02, PNorm = 788.3350, GNorm = 1.2967, lr_0 = 9.9468e-04
Validation auc = 0.689545
Epoch 7656
Loss = 2.6666e-02, PNorm = 788.3636, GNorm = 0.8417, lr_0 = 9.9468e-04
Validation auc = 0.689373
Epoch 7657
Loss = 7.3963e-02, PNorm = 788.3874, GNorm = 0.3945, lr_0 = 9.9468e-04
Validation auc = 0.687721
Epoch 7658
Loss = 1.2365e-01, PNorm = 788.4128, GNorm = 8.5284, lr_0 = 9.9467e-04
Validation auc = 0.685761
Epoch 7659
Loss = 3.1822e-02, PNorm = 788.4466, GNorm = 1.8920, lr_0 = 9.9467e-04
Loss = 5.2848e-02, PNorm = 788.4811, GNorm = 1.7039, lr_0 = 9.9467e-04
Validation auc = 0.676165
Epoch 7660
Loss = 3.3423e-02, PNorm = 788.5137, GNorm = 3.4348, lr_0 = 9.9467e-04
Validation auc = 0.675142
Epoch 7661
Loss = 6.1627e-02, PNorm = 788.5510, GNorm = 1.5599, lr_0 = 9.9467e-04
Validation auc = 0.668911
Epoch 7662
Loss = 3.8702e-02, PNorm = 788.6163, GNorm = 0.9452, lr_0 = 9.9467e-04
Validation auc = 0.657973
Epoch 7663
Loss = 4.3463e-02, PNorm = 788.6781, GNorm = 0.9982, lr_0 = 9.9467e-04
Validation auc = 0.656664
Epoch 7664
Loss = 2.6648e-02, PNorm = 788.7211, GNorm = 0.5286, lr_0 = 9.9467e-04
Validation auc = 0.658753
Epoch 7665
Loss = 2.5611e-02, PNorm = 788.7586, GNorm = 1.0928, lr_0 = 9.9467e-04
Validation auc = 0.669553
Epoch 7666
Loss = 9.5774e-02, PNorm = 788.7968, GNorm = 0.1996, lr_0 = 9.9467e-04
Validation auc = 0.665104
Epoch 7667
Loss = 9.9322e-02, PNorm = 788.8434, GNorm = 1.4922, lr_0 = 9.9467e-04
Validation auc = 0.663119
Epoch 7668
Loss = 5.0776e-02, PNorm = 788.8846, GNorm = 16.4800, lr_0 = 9.9467e-04
Validation auc = 0.682225
Epoch 7669
Loss = 1.1808e-01, PNorm = 788.9300, GNorm = 2.0997, lr_0 = 9.9467e-04
Loss = 4.1361e-02, PNorm = 788.9668, GNorm = 0.3481, lr_0 = 9.9467e-04
Validation auc = 0.690015
Epoch 7670
Loss = 2.5586e-01, PNorm = 789.0175, GNorm = 0.4957, lr_0 = 9.9467e-04
Validation auc = 0.693581
Epoch 7671
Loss = 5.6631e-02, PNorm = 789.0742, GNorm = 1.6001, lr_0 = 9.9466e-04
Validation auc = 0.691441
Epoch 7672
Loss = 3.4171e-02, PNorm = 789.1247, GNorm = 0.6991, lr_0 = 9.9466e-04
Validation auc = 0.691527
Epoch 7673
Loss = 5.1459e-02, PNorm = 789.1598, GNorm = 2.6019, lr_0 = 9.9466e-04
Validation auc = 0.691563
Epoch 7674
Loss = 3.1497e-02, PNorm = 789.1922, GNorm = 0.8038, lr_0 = 9.9466e-04
Validation auc = 0.692479
Epoch 7675
Loss = 4.4289e-02, PNorm = 789.2186, GNorm = 0.6690, lr_0 = 9.9466e-04
Validation auc = 0.694611
Epoch 7676
Loss = 2.9467e-02, PNorm = 789.2473, GNorm = 0.4033, lr_0 = 9.9466e-04
Validation auc = 0.698003
Epoch 7677
Loss = 6.2935e-02, PNorm = 789.2723, GNorm = 8.2920, lr_0 = 9.9466e-04
Validation auc = 0.702523
Epoch 7678
Loss = 5.9257e-02, PNorm = 789.3005, GNorm = 0.2499, lr_0 = 9.9466e-04
Validation auc = 0.704891
Epoch 7679
Loss = 5.6258e-03, PNorm = 789.3329, GNorm = 0.1698, lr_0 = 9.9466e-04
Loss = 3.1161e-02, PNorm = 789.3696, GNorm = 1.8756, lr_0 = 9.9466e-04
Validation auc = 0.703668
Epoch 7680
Loss = 6.1478e-02, PNorm = 789.4006, GNorm = 2.0744, lr_0 = 9.9466e-04
Validation auc = 0.702310
Epoch 7681
Loss = 3.0632e-02, PNorm = 789.4325, GNorm = 0.2716, lr_0 = 9.9466e-04
Validation auc = 0.701062
Epoch 7682
Loss = 5.9524e-02, PNorm = 789.4662, GNorm = 8.0970, lr_0 = 9.9466e-04
Validation auc = 0.695616
Epoch 7683
Loss = 6.5755e-02, PNorm = 789.5040, GNorm = 6.8446, lr_0 = 9.9466e-04
Validation auc = 0.689408
Epoch 7684
Loss = 3.9714e-02, PNorm = 789.5457, GNorm = 0.4845, lr_0 = 9.9465e-04
Validation auc = 0.682305
Epoch 7685
Loss = 3.2134e-02, PNorm = 789.5875, GNorm = 1.2597, lr_0 = 9.9465e-04
Validation auc = 0.681583
Epoch 7686
Loss = 1.2430e-01, PNorm = 789.6252, GNorm = 0.1530, lr_0 = 9.9465e-04
Validation auc = 0.680003
Epoch 7687
Loss = 8.9099e-03, PNorm = 789.6671, GNorm = 0.7055, lr_0 = 9.9465e-04
Validation auc = 0.676983
Epoch 7688
Loss = 1.1052e-01, PNorm = 789.6988, GNorm = 3.9892, lr_0 = 9.9465e-04
Validation auc = 0.677086
Epoch 7689
Loss = 1.6029e-02, PNorm = 789.7419, GNorm = 0.6662, lr_0 = 9.9465e-04
Loss = 7.6564e-02, PNorm = 789.7851, GNorm = 1.1836, lr_0 = 9.9465e-04
Validation auc = 0.679900
Epoch 7690
Loss = 1.9747e-02, PNorm = 789.8206, GNorm = 0.6234, lr_0 = 9.9465e-04
Validation auc = 0.681538
Epoch 7691
Loss = 2.1243e-02, PNorm = 789.8436, GNorm = 1.9337, lr_0 = 9.9465e-04
Validation auc = 0.682625
Epoch 7692
Loss = 3.4113e-02, PNorm = 789.8682, GNorm = 1.4844, lr_0 = 9.9465e-04
Validation auc = 0.683162
Epoch 7693
Loss = 3.0216e-02, PNorm = 789.8937, GNorm = 3.8057, lr_0 = 9.9465e-04
Validation auc = 0.686529
Epoch 7694
Loss = 4.3710e-02, PNorm = 789.9193, GNorm = 1.0321, lr_0 = 9.9465e-04
Validation auc = 0.687298
Epoch 7695
Loss = 2.8354e-02, PNorm = 789.9470, GNorm = 1.4991, lr_0 = 9.9465e-04
Validation auc = 0.683680
Epoch 7696
Loss = 4.5713e-02, PNorm = 789.9778, GNorm = 0.4659, lr_0 = 9.9465e-04
Validation auc = 0.682500
Epoch 7697
Loss = 6.0882e-02, PNorm = 790.0083, GNorm = 2.8950, lr_0 = 9.9465e-04
Validation auc = 0.682814
Epoch 7698
Loss = 7.4561e-02, PNorm = 790.0341, GNorm = 0.7367, lr_0 = 9.9464e-04
Validation auc = 0.684419
Epoch 7699
Loss = 1.0701e-01, PNorm = 790.0599, GNorm = 2.5701, lr_0 = 9.9464e-04
Loss = 7.2101e-02, PNorm = 790.0839, GNorm = 3.6666, lr_0 = 9.9464e-04
Validation auc = 0.690806
Epoch 7700
Loss = 7.5186e-02, PNorm = 790.1128, GNorm = 11.1985, lr_0 = 9.9464e-04
Validation auc = 0.693372
Epoch 7701
Loss = 2.2909e-02, PNorm = 790.1457, GNorm = 0.3536, lr_0 = 9.9464e-04
Validation auc = 0.694391
Epoch 7702
Loss = 1.8443e-02, PNorm = 790.1728, GNorm = 1.2455, lr_0 = 9.9464e-04
Validation auc = 0.693008
Epoch 7703
Loss = 3.5623e-02, PNorm = 790.1984, GNorm = 0.1379, lr_0 = 9.9464e-04
Validation auc = 0.695088
Epoch 7704
Loss = 5.7750e-02, PNorm = 790.2264, GNorm = 9.9051, lr_0 = 9.9464e-04
Validation auc = 0.697082
Epoch 7705
Loss = 3.4557e-02, PNorm = 790.2524, GNorm = 1.2093, lr_0 = 9.9464e-04
Validation auc = 0.695638
Epoch 7706
Loss = 1.9344e-02, PNorm = 790.2808, GNorm = 2.3752, lr_0 = 9.9464e-04
Validation auc = 0.695193
Epoch 7707
Loss = 1.9809e-02, PNorm = 790.3047, GNorm = 0.3576, lr_0 = 9.9464e-04
Validation auc = 0.697583
Epoch 7708
Loss = 1.3056e-02, PNorm = 790.3278, GNorm = 1.3918, lr_0 = 9.9464e-04
Validation auc = 0.698428
Epoch 7709
Loss = 7.0982e-02, PNorm = 790.3522, GNorm = 1.7325, lr_0 = 9.9464e-04
Loss = 2.5383e-02, PNorm = 790.3757, GNorm = 0.3137, lr_0 = 9.9464e-04
Validation auc = 0.697520
Epoch 7710
Loss = 4.2333e-02, PNorm = 790.3933, GNorm = 0.7609, lr_0 = 9.9464e-04
Validation auc = 0.696319
Epoch 7711
Loss = 3.3992e-02, PNorm = 790.4074, GNorm = 2.8995, lr_0 = 9.9463e-04
Validation auc = 0.697668
Epoch 7712
Loss = 3.2999e-02, PNorm = 790.4292, GNorm = 3.3569, lr_0 = 9.9463e-04
Validation auc = 0.697293
Epoch 7713
Loss = 8.9061e-03, PNorm = 790.4534, GNorm = 0.4317, lr_0 = 9.9463e-04
Validation auc = 0.697115
Epoch 7714
Loss = 5.8811e-02, PNorm = 790.4783, GNorm = 1.4502, lr_0 = 9.9463e-04
Validation auc = 0.699038
Epoch 7715
Loss = 3.6590e-02, PNorm = 790.5055, GNorm = 0.2962, lr_0 = 9.9463e-04
Validation auc = 0.696192
Epoch 7716
Loss = 2.6035e-02, PNorm = 790.5335, GNorm = 0.1961, lr_0 = 9.9463e-04
Validation auc = 0.682138
Epoch 7717
Loss = 7.2088e-02, PNorm = 790.5781, GNorm = 6.6965, lr_0 = 9.9463e-04
Validation auc = 0.670920
Epoch 7718
Loss = 3.9184e-02, PNorm = 790.6252, GNorm = 1.6088, lr_0 = 9.9463e-04
Validation auc = 0.667898
Epoch 7719
Loss = 2.2646e-02, PNorm = 790.6582, GNorm = 1.2919, lr_0 = 9.9463e-04
Loss = 5.4464e-02, PNorm = 790.6848, GNorm = 2.1876, lr_0 = 9.9463e-04
Validation auc = 0.666667
Epoch 7720
Loss = 3.2907e-02, PNorm = 790.7149, GNorm = 1.0063, lr_0 = 9.9463e-04
Validation auc = 0.676802
Epoch 7721
Loss = 2.3319e-02, PNorm = 790.7610, GNorm = 1.3475, lr_0 = 9.9463e-04
Validation auc = 0.690440
Epoch 7722
Loss = 3.7348e-02, PNorm = 790.8004, GNorm = 0.7116, lr_0 = 9.9463e-04
Validation auc = 0.689942
Epoch 7723
Loss = 5.2164e-02, PNorm = 790.8399, GNorm = 0.5166, lr_0 = 9.9463e-04
Validation auc = 0.692357
Epoch 7724
Loss = 9.1532e-02, PNorm = 790.8838, GNorm = 0.1911, lr_0 = 9.9462e-04
Validation auc = 0.684338
Epoch 7725
Loss = 1.1790e-02, PNorm = 790.9269, GNorm = 0.4203, lr_0 = 9.9462e-04
Validation auc = 0.686433
Epoch 7726
Loss = 2.9321e-02, PNorm = 790.9636, GNorm = 1.6500, lr_0 = 9.9462e-04
Validation auc = 0.685865
Epoch 7727
Loss = 6.1511e-02, PNorm = 790.9969, GNorm = 8.8715, lr_0 = 9.9462e-04
Validation auc = 0.677454
Epoch 7728
Loss = 4.4162e-02, PNorm = 791.0312, GNorm = 3.7868, lr_0 = 9.9462e-04
Validation auc = 0.670649
Epoch 7729
Loss = 3.8710e-02, PNorm = 791.0629, GNorm = 2.6229, lr_0 = 9.9462e-04
Loss = 7.1570e-02, PNorm = 791.0910, GNorm = 0.5521, lr_0 = 9.9462e-04
Validation auc = 0.668000
Epoch 7730
Loss = 3.1223e-02, PNorm = 791.1241, GNorm = 0.3991, lr_0 = 9.9462e-04
Validation auc = 0.666637
Epoch 7731
Loss = 4.0536e-02, PNorm = 791.1559, GNorm = 0.8314, lr_0 = 9.9462e-04
Validation auc = 0.670120
Epoch 7732
Loss = 4.4472e-02, PNorm = 791.1830, GNorm = 0.3348, lr_0 = 9.9462e-04
Validation auc = 0.672376
Epoch 7733
Loss = 5.8013e-02, PNorm = 791.2123, GNorm = 1.4153, lr_0 = 9.9462e-04
Validation auc = 0.673724
Epoch 7734
Loss = 1.7900e-02, PNorm = 791.2432, GNorm = 0.3744, lr_0 = 9.9462e-04
Validation auc = 0.672242
Epoch 7735
Loss = 4.4285e-02, PNorm = 791.2756, GNorm = 3.8355, lr_0 = 9.9462e-04
Validation auc = 0.669565
Epoch 7736
Loss = 4.5800e-02, PNorm = 791.3144, GNorm = 6.4253, lr_0 = 9.9462e-04
Validation auc = 0.667455
Epoch 7737
Loss = 2.3974e-02, PNorm = 791.3835, GNorm = 0.6226, lr_0 = 9.9462e-04
Validation auc = 0.670587
Epoch 7738
Loss = 4.5512e-02, PNorm = 791.4406, GNorm = 2.5276, lr_0 = 9.9461e-04
Validation auc = 0.672563
Epoch 7739
Loss = 1.0732e-02, PNorm = 791.4881, GNorm = 1.1167, lr_0 = 9.9461e-04
Loss = 5.7741e-02, PNorm = 791.5300, GNorm = 1.6762, lr_0 = 9.9461e-04
Validation auc = 0.675927
Epoch 7740
Loss = 5.5034e-02, PNorm = 791.5691, GNorm = 0.3056, lr_0 = 9.9461e-04
Validation auc = 0.679271
Epoch 7741
Loss = 3.5770e-02, PNorm = 791.6017, GNorm = 0.5360, lr_0 = 9.9461e-04
Validation auc = 0.678877
Epoch 7742
Loss = 1.3157e-02, PNorm = 791.6302, GNorm = 3.0419, lr_0 = 9.9461e-04
Validation auc = 0.679984
Epoch 7743
Loss = 1.0604e-02, PNorm = 791.6520, GNorm = 2.5026, lr_0 = 9.9461e-04
Validation auc = 0.678933
Epoch 7744
Loss = 2.8320e-02, PNorm = 791.6758, GNorm = 0.8322, lr_0 = 9.9461e-04
Validation auc = 0.682814
Epoch 7745
Loss = 7.6050e-02, PNorm = 791.7078, GNorm = 1.8813, lr_0 = 9.9461e-04
Validation auc = 0.687737
Epoch 7746
Loss = 1.9667e-02, PNorm = 791.7446, GNorm = 0.9856, lr_0 = 9.9461e-04
Validation auc = 0.691165
Epoch 7747
Loss = 8.3329e-03, PNorm = 791.7737, GNorm = 0.7466, lr_0 = 9.9461e-04
Validation auc = 0.690745
Epoch 7748
Loss = 6.0043e-02, PNorm = 791.7956, GNorm = 1.0661, lr_0 = 9.9461e-04
Validation auc = 0.688216
Epoch 7749
Loss = 1.2781e-02, PNorm = 791.8234, GNorm = 0.8929, lr_0 = 9.9461e-04
Loss = 3.2219e-02, PNorm = 791.8467, GNorm = 0.6165, lr_0 = 9.9461e-04
Validation auc = 0.689304
Epoch 7750
Loss = 1.1108e-02, PNorm = 791.8690, GNorm = 1.0887, lr_0 = 9.9460e-04
Validation auc = 0.689701
Epoch 7751
Loss = 1.9918e-02, PNorm = 791.8911, GNorm = 0.1026, lr_0 = 9.9460e-04
Validation auc = 0.686197
Epoch 7752
Loss = 1.1046e-02, PNorm = 791.9153, GNorm = 0.8625, lr_0 = 9.9460e-04
Validation auc = 0.683259
Epoch 7753
Loss = 7.1667e-02, PNorm = 791.9516, GNorm = 0.4311, lr_0 = 9.9460e-04
Validation auc = 0.682342
Epoch 7754
Loss = 4.5946e-02, PNorm = 792.0014, GNorm = 0.4661, lr_0 = 9.9460e-04
Validation auc = 0.676958
Epoch 7755
Loss = 4.6309e-02, PNorm = 792.0531, GNorm = 1.7178, lr_0 = 9.9460e-04
Validation auc = 0.665948
Epoch 7756
Loss = 7.6455e-02, PNorm = 792.0993, GNorm = 0.8839, lr_0 = 9.9460e-04
Validation auc = 0.662701
Epoch 7757
Loss = 6.5775e-02, PNorm = 792.1347, GNorm = 4.3582, lr_0 = 9.9460e-04
Validation auc = 0.664433
Epoch 7758
Loss = 9.4717e-02, PNorm = 792.1598, GNorm = 2.1976, lr_0 = 9.9460e-04
Validation auc = 0.663756
Epoch 7759
Loss = 6.0797e-02, PNorm = 792.1804, GNorm = 1.8159, lr_0 = 9.9460e-04
Loss = 6.1633e-02, PNorm = 792.2049, GNorm = 1.7891, lr_0 = 9.9460e-04
Validation auc = 0.667741
Epoch 7760
Loss = 3.7286e-02, PNorm = 792.2313, GNorm = 2.5656, lr_0 = 9.9460e-04
Validation auc = 0.667223
Epoch 7761
Loss = 4.5342e-02, PNorm = 792.2597, GNorm = 1.3281, lr_0 = 9.9460e-04
Validation auc = 0.670748
Epoch 7762
Loss = 6.6794e-02, PNorm = 792.2988, GNorm = 0.2773, lr_0 = 9.9460e-04
Validation auc = 0.679432
Epoch 7763
Loss = 3.3476e-02, PNorm = 792.3381, GNorm = 1.3524, lr_0 = 9.9460e-04
Validation auc = 0.685573
Epoch 7764
Loss = 2.4723e-02, PNorm = 792.3740, GNorm = 1.7938, lr_0 = 9.9459e-04
Validation auc = 0.682686
Epoch 7765
Loss = 2.8657e-02, PNorm = 792.4069, GNorm = 0.2222, lr_0 = 9.9459e-04
Validation auc = 0.681481
Epoch 7766
Loss = 5.6462e-02, PNorm = 792.4421, GNorm = 0.1807, lr_0 = 9.9459e-04
Validation auc = 0.681427
Epoch 7767
Loss = 1.6653e-02, PNorm = 792.4709, GNorm = 0.3048, lr_0 = 9.9459e-04
Validation auc = 0.680246
Epoch 7768
Loss = 3.2900e-02, PNorm = 792.4959, GNorm = 2.7065, lr_0 = 9.9459e-04
Validation auc = 0.674049
Epoch 7769
Loss = 1.5265e-02, PNorm = 792.5189, GNorm = 0.5828, lr_0 = 9.9459e-04
Loss = 4.3936e-02, PNorm = 792.5428, GNorm = 0.3798, lr_0 = 9.9459e-04
Validation auc = 0.669963
Epoch 7770
Loss = 1.6682e-02, PNorm = 792.5755, GNorm = 1.0626, lr_0 = 9.9459e-04
Validation auc = 0.672121
Epoch 7771
Loss = 2.7247e-02, PNorm = 792.5990, GNorm = 0.3805, lr_0 = 9.9459e-04
Validation auc = 0.674570
Epoch 7772
Loss = 2.0851e-02, PNorm = 792.6175, GNorm = 2.2064, lr_0 = 9.9459e-04
Validation auc = 0.675821
Epoch 7773
Loss = 4.7584e-02, PNorm = 792.6381, GNorm = 0.2363, lr_0 = 9.9459e-04
Validation auc = 0.672991
Epoch 7774
Loss = 1.2049e-02, PNorm = 792.6629, GNorm = 1.3231, lr_0 = 9.9459e-04
Validation auc = 0.670819
Epoch 7775
Loss = 2.3389e-01, PNorm = 792.6869, GNorm = 0.6816, lr_0 = 9.9459e-04
Validation auc = 0.667963
Epoch 7776
Loss = 3.9963e-02, PNorm = 792.7298, GNorm = 1.4190, lr_0 = 9.9459e-04
Validation auc = 0.669535
Epoch 7777
Loss = 5.3421e-02, PNorm = 792.7686, GNorm = 11.3486, lr_0 = 9.9459e-04
Validation auc = 0.672473
Epoch 7778
Loss = 4.2556e-02, PNorm = 792.8222, GNorm = 1.9278, lr_0 = 9.9458e-04
Validation auc = 0.673865
Epoch 7779
Loss = 7.3006e-02, PNorm = 792.8722, GNorm = 3.0195, lr_0 = 9.9458e-04
Loss = 7.3240e-02, PNorm = 792.9169, GNorm = 0.5161, lr_0 = 9.9458e-04
Validation auc = 0.675191
Epoch 7780
Loss = 4.8942e-02, PNorm = 792.9537, GNorm = 0.8183, lr_0 = 9.9458e-04
Validation auc = 0.678379
Epoch 7781
Loss = 3.4330e-02, PNorm = 792.9897, GNorm = 0.5642, lr_0 = 9.9458e-04
Validation auc = 0.682319
Epoch 7782
Loss = 2.8636e-02, PNorm = 793.0244, GNorm = 1.0711, lr_0 = 9.9458e-04
Validation auc = 0.684636
Epoch 7783
Loss = 3.6340e-02, PNorm = 793.0524, GNorm = 2.0344, lr_0 = 9.9458e-04
Validation auc = 0.685365
Epoch 7784
Loss = 3.6596e-02, PNorm = 793.0783, GNorm = 1.5020, lr_0 = 9.9458e-04
Validation auc = 0.685183
Epoch 7785
Loss = 1.6967e-02, PNorm = 793.1021, GNorm = 2.2362, lr_0 = 9.9458e-04
Validation auc = 0.680393
Epoch 7786
Loss = 2.3322e-02, PNorm = 793.1361, GNorm = 1.1953, lr_0 = 9.9458e-04
Validation auc = 0.677826
Epoch 7787
Loss = 5.4458e-02, PNorm = 793.1718, GNorm = 2.3627, lr_0 = 9.9458e-04
Validation auc = 0.682337
Epoch 7788
Loss = 1.9062e-01, PNorm = 793.2036, GNorm = 9.3580, lr_0 = 9.9458e-04
Validation auc = 0.691478
Epoch 7789
Loss = 2.1434e-01, PNorm = 793.2437, GNorm = 8.6442, lr_0 = 9.9458e-04
Loss = 6.3402e-02, PNorm = 793.2917, GNorm = 1.6439, lr_0 = 9.9458e-04
Validation auc = 0.692175
Epoch 7790
Loss = 2.7527e-02, PNorm = 793.3408, GNorm = 1.4764, lr_0 = 9.9457e-04
Validation auc = 0.691017
Epoch 7791
Loss = 6.0809e-02, PNorm = 793.3770, GNorm = 1.9657, lr_0 = 9.9457e-04
Validation auc = 0.689774
Epoch 7792
Loss = 4.6445e-02, PNorm = 793.4046, GNorm = 3.3718, lr_0 = 9.9457e-04
Validation auc = 0.690916
Epoch 7793
Loss = 1.7731e-02, PNorm = 793.4347, GNorm = 1.0816, lr_0 = 9.9457e-04
Validation auc = 0.693131
Epoch 7794
Loss = 3.5684e-02, PNorm = 793.4620, GNorm = 0.5189, lr_0 = 9.9457e-04
Validation auc = 0.693374
Epoch 7795
Loss = 3.4148e-02, PNorm = 793.4929, GNorm = 0.5291, lr_0 = 9.9457e-04
Validation auc = 0.694099
Epoch 7796
Loss = 3.5364e-02, PNorm = 793.5255, GNorm = 2.4397, lr_0 = 9.9457e-04
Validation auc = 0.699649
Epoch 7797
Loss = 5.0626e-02, PNorm = 793.5578, GNorm = 6.7167, lr_0 = 9.9457e-04
Validation auc = 0.702540
Epoch 7798
Loss = 2.0907e-02, PNorm = 793.5997, GNorm = 1.4825, lr_0 = 9.9457e-04
Validation auc = 0.704374
Epoch 7799
Loss = 4.0277e-02, PNorm = 793.6418, GNorm = 1.7664, lr_0 = 9.9457e-04
Loss = 3.1128e-02, PNorm = 793.6783, GNorm = 1.6321, lr_0 = 9.9457e-04
Validation auc = 0.703045
Epoch 7800
Loss = 3.1435e-02, PNorm = 793.7126, GNorm = 1.4467, lr_0 = 9.9457e-04
Validation auc = 0.700721
Epoch 7801
Loss = 2.1682e-02, PNorm = 793.7430, GNorm = 1.5495, lr_0 = 9.9457e-04
Validation auc = 0.700709
Epoch 7802
Loss = 3.7768e-02, PNorm = 793.7720, GNorm = 1.1806, lr_0 = 9.9457e-04
Validation auc = 0.698497
Epoch 7803
Loss = 2.8450e-02, PNorm = 793.7988, GNorm = 2.0896, lr_0 = 9.9457e-04
Validation auc = 0.699132
Epoch 7804
Loss = 8.5212e-03, PNorm = 793.8199, GNorm = 0.2198, lr_0 = 9.9456e-04
Validation auc = 0.697490
Epoch 7805
Loss = 6.6930e-02, PNorm = 793.8439, GNorm = 1.3717, lr_0 = 9.9456e-04
Validation auc = 0.693953
Epoch 7806
Loss = 1.1852e-02, PNorm = 793.8766, GNorm = 1.1293, lr_0 = 9.9456e-04
Validation auc = 0.694079
Epoch 7807
Loss = 6.5929e-03, PNorm = 793.9019, GNorm = 0.2918, lr_0 = 9.9456e-04
Validation auc = 0.690861
Epoch 7808
Loss = 5.2277e-03, PNorm = 793.9291, GNorm = 0.2117, lr_0 = 9.9456e-04
Validation auc = 0.686501
Epoch 7809
Loss = 2.4366e-01, PNorm = 793.9644, GNorm = 7.4753, lr_0 = 9.9456e-04
Loss = 3.2148e-02, PNorm = 794.0006, GNorm = 0.2115, lr_0 = 9.9456e-04
Validation auc = 0.687299
Epoch 7810
Loss = 2.9771e-02, PNorm = 794.0293, GNorm = 2.3485, lr_0 = 9.9456e-04
Validation auc = 0.688550
Epoch 7811
Loss = 5.5117e-02, PNorm = 794.0540, GNorm = 7.0240, lr_0 = 9.9456e-04
Validation auc = 0.688340
Epoch 7812
Loss = 6.1511e-02, PNorm = 794.0904, GNorm = 0.6355, lr_0 = 9.9456e-04
Validation auc = 0.685552
Epoch 7813
Loss = 2.1176e-02, PNorm = 794.1273, GNorm = 2.6907, lr_0 = 9.9456e-04
Validation auc = 0.686438
Epoch 7814
Loss = 5.4872e-02, PNorm = 794.1630, GNorm = 0.5782, lr_0 = 9.9456e-04
Validation auc = 0.685025
Epoch 7815
Loss = 2.9249e-02, PNorm = 794.1967, GNorm = 1.3536, lr_0 = 9.9456e-04
Validation auc = 0.684208
Epoch 7816
Loss = 1.8961e-02, PNorm = 794.2225, GNorm = 0.2549, lr_0 = 9.9456e-04
Validation auc = 0.683975
Epoch 7817
Loss = 7.5403e-02, PNorm = 794.2448, GNorm = 7.0846, lr_0 = 9.9455e-04
Validation auc = 0.687134
Epoch 7818
Loss = 2.5737e-03, PNorm = 794.2786, GNorm = 0.2936, lr_0 = 9.9455e-04
Validation auc = 0.688170
Epoch 7819
Loss = 4.0974e-02, PNorm = 794.3053, GNorm = 1.8405, lr_0 = 9.9455e-04
Loss = 6.5510e-02, PNorm = 794.3396, GNorm = 1.9267, lr_0 = 9.9455e-04
Validation auc = 0.686145
Epoch 7820
Loss = 2.2271e-02, PNorm = 794.3806, GNorm = 0.7886, lr_0 = 9.9455e-04
Validation auc = 0.683279
Epoch 7821
Loss = 4.9856e-02, PNorm = 794.4128, GNorm = 4.2947, lr_0 = 9.9455e-04
Validation auc = 0.677025
Epoch 7822
Loss = 4.6763e-02, PNorm = 794.4469, GNorm = 1.1301, lr_0 = 9.9455e-04
Validation auc = 0.675156
Epoch 7823
Loss = 5.6700e-02, PNorm = 794.4811, GNorm = 0.8723, lr_0 = 9.9455e-04
Validation auc = 0.677376
Epoch 7824
Loss = 2.3453e-02, PNorm = 794.5327, GNorm = 0.6009, lr_0 = 9.9455e-04
Validation auc = 0.687190
Epoch 7825
Loss = 2.2297e-02, PNorm = 794.5766, GNorm = 1.0522, lr_0 = 9.9455e-04
Validation auc = 0.688651
Epoch 7826
Loss = 1.5673e-02, PNorm = 794.6116, GNorm = 1.2403, lr_0 = 9.9455e-04
Validation auc = 0.688520
Epoch 7827
Loss = 2.0058e-02, PNorm = 794.6402, GNorm = 1.9044, lr_0 = 9.9455e-04
Validation auc = 0.689839
Epoch 7828
Loss = 2.7702e-02, PNorm = 794.6770, GNorm = 4.2986, lr_0 = 9.9455e-04
Validation auc = 0.692146
Epoch 7829
Loss = 9.5688e-02, PNorm = 794.7227, GNorm = 5.7040, lr_0 = 9.9455e-04
Loss = 6.1179e-02, PNorm = 794.7787, GNorm = 14.2921, lr_0 = 9.9455e-04
Validation auc = 0.695275
Epoch 7830
Loss = 3.2783e-02, PNorm = 794.8323, GNorm = 0.5750, lr_0 = 9.9454e-04
Validation auc = 0.691961
Epoch 7831
Loss = 2.5717e-02, PNorm = 794.9134, GNorm = 0.7521, lr_0 = 9.9454e-04
Validation auc = 0.695002
Epoch 7832
Loss = 3.1020e-02, PNorm = 794.9748, GNorm = 0.2310, lr_0 = 9.9454e-04
Validation auc = 0.693837
Epoch 7833
Loss = 5.6272e-02, PNorm = 795.0220, GNorm = 7.5282, lr_0 = 9.9454e-04
Validation auc = 0.690620
Epoch 7834
Loss = 5.0913e-02, PNorm = 795.0737, GNorm = 0.4255, lr_0 = 9.9454e-04
Validation auc = 0.693275
Epoch 7835
Loss = 3.9193e-02, PNorm = 795.1207, GNorm = 3.8812, lr_0 = 9.9454e-04
Validation auc = 0.696630
Epoch 7836
Loss = 1.6693e-01, PNorm = 795.1629, GNorm = 3.4511, lr_0 = 9.9454e-04
Validation auc = 0.688860
Epoch 7837
Loss = 9.5837e-02, PNorm = 795.2126, GNorm = 5.3948, lr_0 = 9.9454e-04
Validation auc = 0.679285
Epoch 7838
Loss = 6.7471e-02, PNorm = 795.2604, GNorm = 1.7614, lr_0 = 9.9454e-04
Validation auc = 0.672184
Epoch 7839
Loss = 4.8598e-02, PNorm = 795.3130, GNorm = 1.2285, lr_0 = 9.9454e-04
Loss = 9.1886e-02, PNorm = 795.3655, GNorm = 0.3535, lr_0 = 9.9454e-04
Validation auc = 0.673435
Epoch 7840
Loss = 1.1218e-01, PNorm = 795.4440, GNorm = 1.0859, lr_0 = 9.9454e-04
Validation auc = 0.679700
Epoch 7841
Loss = 1.3964e-01, PNorm = 795.5198, GNorm = 1.6273, lr_0 = 9.9454e-04
Validation auc = 0.684752
Epoch 7842
Loss = 7.5726e-02, PNorm = 795.5812, GNorm = 2.4465, lr_0 = 9.9454e-04
Validation auc = 0.685556
Epoch 7843
Loss = 5.9586e-02, PNorm = 795.6358, GNorm = 2.2731, lr_0 = 9.9454e-04
Validation auc = 0.686126
Epoch 7844
Loss = 8.5743e-02, PNorm = 795.6777, GNorm = 0.8631, lr_0 = 9.9453e-04
Validation auc = 0.679979
Epoch 7845
Loss = 2.1235e-02, PNorm = 795.7179, GNorm = 1.3504, lr_0 = 9.9453e-04
Validation auc = 0.674598
Epoch 7846
Loss = 3.2774e-02, PNorm = 795.7513, GNorm = 1.4771, lr_0 = 9.9453e-04
Validation auc = 0.672473
Epoch 7847
Loss = 2.7160e-02, PNorm = 795.7926, GNorm = 0.8315, lr_0 = 9.9453e-04
Validation auc = 0.673916
Epoch 7848
Loss = 2.7732e-02, PNorm = 795.8364, GNorm = 2.4637, lr_0 = 9.9453e-04
Validation auc = 0.679006
Epoch 7849
Loss = 2.0324e-02, PNorm = 795.8705, GNorm = 1.7649, lr_0 = 9.9453e-04
Loss = 4.3302e-02, PNorm = 795.8973, GNorm = 0.2469, lr_0 = 9.9453e-04
Validation auc = 0.682928
Epoch 7850
Loss = 3.9827e-02, PNorm = 795.9310, GNorm = 2.8803, lr_0 = 9.9453e-04
Validation auc = 0.684900
Epoch 7851
Loss = 8.1688e-02, PNorm = 795.9682, GNorm = 1.1185, lr_0 = 9.9453e-04
Validation auc = 0.683520
Epoch 7852
Loss = 3.7777e-02, PNorm = 796.0123, GNorm = 1.1217, lr_0 = 9.9453e-04
Validation auc = 0.687974
Epoch 7853
Loss = 7.0105e-02, PNorm = 796.0550, GNorm = 2.9177, lr_0 = 9.9453e-04
Validation auc = 0.691251
Epoch 7854
Loss = 7.4942e-02, PNorm = 796.1138, GNorm = 9.5153, lr_0 = 9.9453e-04
Validation auc = 0.680656
Epoch 7855
Loss = 4.0915e-02, PNorm = 796.1876, GNorm = 1.8342, lr_0 = 9.9453e-04
Validation auc = 0.674563
Epoch 7856
Loss = 4.1043e-02, PNorm = 796.2513, GNorm = 3.8222, lr_0 = 9.9453e-04
Validation auc = 0.678652
Epoch 7857
Loss = 4.9549e-02, PNorm = 796.3139, GNorm = 0.6606, lr_0 = 9.9452e-04
Validation auc = 0.677587
Epoch 7858
Loss = 1.6133e-02, PNorm = 796.3635, GNorm = 0.1893, lr_0 = 9.9452e-04
Validation auc = 0.674707
Epoch 7859
Loss = 1.7575e-02, PNorm = 796.3970, GNorm = 1.7144, lr_0 = 9.9452e-04
Loss = 2.2346e-02, PNorm = 796.4244, GNorm = 3.9281, lr_0 = 9.9452e-04
Validation auc = 0.673778
Epoch 7860
Loss = 5.3694e-02, PNorm = 796.4493, GNorm = 0.0901, lr_0 = 9.9452e-04
Validation auc = 0.668345
Epoch 7861
Loss = 6.9341e-02, PNorm = 796.4775, GNorm = 4.0524, lr_0 = 9.9452e-04
Validation auc = 0.663392
Epoch 7862
Loss = 6.3031e-02, PNorm = 796.5101, GNorm = 5.8736, lr_0 = 9.9452e-04
Validation auc = 0.664391
Epoch 7863
Loss = 3.9834e-02, PNorm = 796.5367, GNorm = 3.5469, lr_0 = 9.9452e-04
Validation auc = 0.665566
Epoch 7864
Loss = 2.6151e-02, PNorm = 796.5631, GNorm = 0.4344, lr_0 = 9.9452e-04
Validation auc = 0.666464
Epoch 7865
Loss = 2.9050e-02, PNorm = 796.5859, GNorm = 2.8984, lr_0 = 9.9452e-04
Validation auc = 0.665844
Epoch 7866
Loss = 2.9309e-02, PNorm = 796.6120, GNorm = 0.6338, lr_0 = 9.9452e-04
Validation auc = 0.666879
Epoch 7867
Loss = 2.4730e-02, PNorm = 796.6504, GNorm = 1.2443, lr_0 = 9.9452e-04
Validation auc = 0.663882
Epoch 7868
Loss = 9.7792e-02, PNorm = 796.6887, GNorm = 3.8045, lr_0 = 9.9452e-04
Validation auc = 0.664175
Epoch 7869
Loss = 1.6192e-02, PNorm = 796.7209, GNorm = 1.0033, lr_0 = 9.9452e-04
Loss = 3.5826e-02, PNorm = 796.7568, GNorm = 2.8983, lr_0 = 9.9452e-04
Validation auc = 0.667152
Epoch 7870
Loss = 3.0306e-02, PNorm = 796.7906, GNorm = 0.4819, lr_0 = 9.9451e-04
Validation auc = 0.661127
Epoch 7871
Loss = 1.6654e-01, PNorm = 796.8417, GNorm = 0.9816, lr_0 = 9.9451e-04
Validation auc = 0.640381
Epoch 7872
Loss = 8.8685e-02, PNorm = 796.8967, GNorm = 1.3726, lr_0 = 9.9451e-04
Validation auc = 0.654012
Epoch 7873
Loss = 1.0045e-01, PNorm = 796.9514, GNorm = 2.2212, lr_0 = 9.9451e-04
Validation auc = 0.650111
Epoch 7874
Loss = 8.3182e-02, PNorm = 797.0104, GNorm = 1.1767, lr_0 = 9.9451e-04
Validation auc = 0.653015
Epoch 7875
Loss = 9.7640e-02, PNorm = 797.0652, GNorm = 6.4845, lr_0 = 9.9451e-04
Validation auc = 0.649371
Epoch 7876
Loss = 8.2175e-02, PNorm = 797.1197, GNorm = 1.8876, lr_0 = 9.9451e-04
Validation auc = 0.650616
Epoch 7877
Loss = 3.9595e-02, PNorm = 797.1624, GNorm = 1.4939, lr_0 = 9.9451e-04
Validation auc = 0.651277
Epoch 7878
Loss = 4.9547e-02, PNorm = 797.2039, GNorm = 0.5733, lr_0 = 9.9451e-04
Validation auc = 0.651336
Epoch 7879
Loss = 9.5958e-02, PNorm = 797.2479, GNorm = 3.0410, lr_0 = 9.9451e-04
Loss = 8.1760e-02, PNorm = 797.2875, GNorm = 10.3694, lr_0 = 9.9451e-04
Validation auc = 0.656484
Epoch 7880
Loss = 3.7227e-02, PNorm = 797.3302, GNorm = 1.0671, lr_0 = 9.9451e-04
Validation auc = 0.660772
Epoch 7881
Loss = 3.3832e-02, PNorm = 797.3673, GNorm = 6.1272, lr_0 = 9.9451e-04
Validation auc = 0.660735
Epoch 7882
Loss = 5.3484e-02, PNorm = 797.4029, GNorm = 0.5220, lr_0 = 9.9451e-04
Validation auc = 0.655052
Epoch 7883
Loss = 1.9441e-02, PNorm = 797.4342, GNorm = 2.4969, lr_0 = 9.9450e-04
Validation auc = 0.655715
Epoch 7884
Loss = 6.2779e-02, PNorm = 797.4574, GNorm = 5.3611, lr_0 = 9.9450e-04
Validation auc = 0.657391
Epoch 7885
Loss = 5.0304e-02, PNorm = 797.4844, GNorm = 0.3674, lr_0 = 9.9450e-04
Validation auc = 0.655603
Epoch 7886
Loss = 3.8162e-02, PNorm = 797.5101, GNorm = 0.5078, lr_0 = 9.9450e-04
Validation auc = 0.654384
Epoch 7887
Loss = 3.7104e-02, PNorm = 797.5362, GNorm = 3.4860, lr_0 = 9.9450e-04
Validation auc = 0.651352
Epoch 7888
Loss = 5.8666e-02, PNorm = 797.5629, GNorm = 1.9107, lr_0 = 9.9450e-04
Validation auc = 0.653778
Epoch 7889
Loss = 1.0644e-01, PNorm = 797.5966, GNorm = 4.4071, lr_0 = 9.9450e-04
Loss = 2.3215e-02, PNorm = 797.6339, GNorm = 0.5485, lr_0 = 9.9450e-04
Validation auc = 0.660105
Epoch 7890
Loss = 2.3143e-02, PNorm = 797.6683, GNorm = 0.6147, lr_0 = 9.9450e-04
Validation auc = 0.658305
Epoch 7891
Loss = 4.1113e-02, PNorm = 797.7182, GNorm = 2.0942, lr_0 = 9.9450e-04
Validation auc = 0.660882
Epoch 7892
Loss = 2.6567e-02, PNorm = 797.7623, GNorm = 0.9940, lr_0 = 9.9450e-04
Validation auc = 0.663368
Epoch 7893
Loss = 4.1651e-02, PNorm = 797.7981, GNorm = 4.1323, lr_0 = 9.9450e-04
Validation auc = 0.661151
Epoch 7894
Loss = 7.7883e-02, PNorm = 797.8391, GNorm = 2.3910, lr_0 = 9.9450e-04
Validation auc = 0.667591
Epoch 7895
Loss = 7.1005e-02, PNorm = 797.8849, GNorm = 0.5030, lr_0 = 9.9450e-04
Validation auc = 0.671450
Epoch 7896
Loss = 2.4250e-02, PNorm = 797.9261, GNorm = 0.9858, lr_0 = 9.9450e-04
Validation auc = 0.669722
Epoch 7897
Loss = 2.3891e-02, PNorm = 797.9626, GNorm = 1.1783, lr_0 = 9.9449e-04
Validation auc = 0.668005
Epoch 7898
Loss = 3.3916e-02, PNorm = 797.9918, GNorm = 1.6267, lr_0 = 9.9449e-04
Validation auc = 0.670402
Epoch 7899
Loss = 3.3450e-02, PNorm = 798.0178, GNorm = 4.7943, lr_0 = 9.9449e-04
Loss = 1.5174e-02, PNorm = 798.0483, GNorm = 2.4028, lr_0 = 9.9449e-04
Validation auc = 0.675109
Epoch 7900
Loss = 2.4093e-02, PNorm = 798.0770, GNorm = 6.0921, lr_0 = 9.9449e-04
Validation auc = 0.681127
Epoch 7901
Loss = 2.4861e-02, PNorm = 798.1035, GNorm = 0.8176, lr_0 = 9.9449e-04
Validation auc = 0.687892
Epoch 7902
Loss = 9.7726e-02, PNorm = 798.1374, GNorm = 3.6366, lr_0 = 9.9449e-04
Validation auc = 0.680895
Epoch 7903
Loss = 7.5413e-02, PNorm = 798.1871, GNorm = 0.6032, lr_0 = 9.9449e-04
Validation auc = 0.681324
Epoch 7904
Loss = 3.8583e-02, PNorm = 798.2284, GNorm = 2.0510, lr_0 = 9.9449e-04
Validation auc = 0.678908
Epoch 7905
Loss = 1.0101e-02, PNorm = 798.2697, GNorm = 0.2310, lr_0 = 9.9449e-04
Validation auc = 0.670350
Epoch 7906
Loss = 6.0115e-02, PNorm = 798.3131, GNorm = 1.4425, lr_0 = 9.9449e-04
Validation auc = 0.667647
Epoch 7907
Loss = 2.4096e-02, PNorm = 798.3581, GNorm = 0.7752, lr_0 = 9.9449e-04
Validation auc = 0.666863
Epoch 7908
Loss = 1.5743e-02, PNorm = 798.3975, GNorm = 1.3778, lr_0 = 9.9449e-04
Validation auc = 0.668796
Epoch 7909
Loss = 1.8949e-02, PNorm = 798.4489, GNorm = 5.4406, lr_0 = 9.9449e-04
Loss = 1.0146e-01, PNorm = 798.4948, GNorm = 6.4968, lr_0 = 9.9449e-04
Validation auc = 0.678281
Epoch 7910
Loss = 6.1251e-02, PNorm = 798.5453, GNorm = 0.8375, lr_0 = 9.9448e-04
Validation auc = 0.675045
Epoch 7911
Loss = 6.5700e-02, PNorm = 798.5940, GNorm = 2.1708, lr_0 = 9.9448e-04
Validation auc = 0.672221
Epoch 7912
Loss = 1.9477e-02, PNorm = 798.6381, GNorm = 0.5111, lr_0 = 9.9448e-04
Validation auc = 0.668697
Epoch 7913
Loss = 5.2431e-02, PNorm = 798.6755, GNorm = 0.9670, lr_0 = 9.9448e-04
Validation auc = 0.673256
Epoch 7914
Loss = 2.7492e-02, PNorm = 798.7134, GNorm = 0.7995, lr_0 = 9.9448e-04
Validation auc = 0.676158
Epoch 7915
Loss = 7.0991e-02, PNorm = 798.7476, GNorm = 7.0241, lr_0 = 9.9448e-04
Validation auc = 0.678371
Epoch 7916
Loss = 2.9710e-02, PNorm = 798.7852, GNorm = 4.4719, lr_0 = 9.9448e-04
Validation auc = 0.669645
Epoch 7917
Loss = 3.5672e-02, PNorm = 798.8296, GNorm = 0.9593, lr_0 = 9.9448e-04
Validation auc = 0.655514
Epoch 7918
Loss = 1.7299e-01, PNorm = 798.8772, GNorm = 6.5062, lr_0 = 9.9448e-04
Validation auc = 0.647603
Epoch 7919
Loss = 2.7837e-02, PNorm = 798.9273, GNorm = 1.4717, lr_0 = 9.9448e-04
Loss = 4.6203e-02, PNorm = 798.9696, GNorm = 2.9683, lr_0 = 9.9448e-04
Validation auc = 0.649806
Epoch 7920
Loss = 2.8126e-02, PNorm = 799.0039, GNorm = 0.4148, lr_0 = 9.9448e-04
Validation auc = 0.652926
Epoch 7921
Loss = 7.9223e-02, PNorm = 799.0374, GNorm = 2.9347, lr_0 = 9.9448e-04
Validation auc = 0.657196
Epoch 7922
Loss = 2.1997e-02, PNorm = 799.0753, GNorm = 0.2450, lr_0 = 9.9448e-04
Validation auc = 0.655161
Epoch 7923
Loss = 1.3064e-01, PNorm = 799.1364, GNorm = 1.3384, lr_0 = 9.9447e-04
Validation auc = 0.682248
Epoch 7924
Loss = 4.5638e-02, PNorm = 799.2306, GNorm = 0.8540, lr_0 = 9.9447e-04
Validation auc = 0.689595
Epoch 7925
Loss = 6.2478e-02, PNorm = 799.3013, GNorm = 5.1371, lr_0 = 9.9447e-04
Validation auc = 0.690385
Epoch 7926
Loss = 1.2068e-02, PNorm = 799.3526, GNorm = 0.3599, lr_0 = 9.9447e-04
Validation auc = 0.690009
Epoch 7927
Loss = 2.1687e-02, PNorm = 799.3900, GNorm = 0.8346, lr_0 = 9.9447e-04
Validation auc = 0.685741
Epoch 7928
Loss = 3.9673e-02, PNorm = 799.4240, GNorm = 0.1639, lr_0 = 9.9447e-04
Validation auc = 0.683386
Epoch 7929
Loss = 6.0179e-03, PNorm = 799.4541, GNorm = 0.3205, lr_0 = 9.9447e-04
Loss = 6.9991e-02, PNorm = 799.4849, GNorm = 1.0487, lr_0 = 9.9447e-04
Validation auc = 0.680556
Epoch 7930
Loss = 2.7966e-02, PNorm = 799.5209, GNorm = 1.6849, lr_0 = 9.9447e-04
Validation auc = 0.683086
Epoch 7931
Loss = 5.5789e-02, PNorm = 799.5532, GNorm = 1.3650, lr_0 = 9.9447e-04
Validation auc = 0.685462
Epoch 7932
Loss = 6.0667e-02, PNorm = 799.5856, GNorm = 0.2675, lr_0 = 9.9447e-04
Validation auc = 0.673332
Epoch 7933
Loss = 5.7191e-02, PNorm = 799.6355, GNorm = 0.8129, lr_0 = 9.9447e-04
Validation auc = 0.669831
Epoch 7934
Loss = 7.8710e-02, PNorm = 799.6890, GNorm = 0.8839, lr_0 = 9.9447e-04
Validation auc = 0.667083
Epoch 7935
Loss = 4.5876e-02, PNorm = 799.7347, GNorm = 1.2200, lr_0 = 9.9447e-04
Validation auc = 0.669374
Epoch 7936
Loss = 7.2879e-02, PNorm = 799.7769, GNorm = 0.3984, lr_0 = 9.9447e-04
Validation auc = 0.672235
Epoch 7937
Loss = 4.9671e-02, PNorm = 799.8153, GNorm = 0.5441, lr_0 = 9.9446e-04
Validation auc = 0.678704
Epoch 7938
Loss = 3.2405e-02, PNorm = 799.8512, GNorm = 2.0302, lr_0 = 9.9446e-04
Validation auc = 0.682228
Epoch 7939
Loss = 1.5914e-01, PNorm = 799.8849, GNorm = 3.5383, lr_0 = 9.9446e-04
Loss = 2.4315e-02, PNorm = 799.9191, GNorm = 2.0359, lr_0 = 9.9446e-04
Validation auc = 0.682662
Epoch 7940
Loss = 2.0935e-02, PNorm = 799.9606, GNorm = 1.2414, lr_0 = 9.9446e-04
Validation auc = 0.682405
Epoch 7941
Loss = 6.5757e-02, PNorm = 799.9960, GNorm = 0.2822, lr_0 = 9.9446e-04
Validation auc = 0.683313
Epoch 7942
Loss = 2.6473e-02, PNorm = 800.0363, GNorm = 1.9689, lr_0 = 9.9446e-04
Validation auc = 0.685210
Epoch 7943
Loss = 3.3934e-02, PNorm = 800.0697, GNorm = 2.2977, lr_0 = 9.9446e-04
Validation auc = 0.685070
Epoch 7944
Loss = 4.0001e-02, PNorm = 800.1091, GNorm = 1.2102, lr_0 = 9.9446e-04
Validation auc = 0.695994
Epoch 7945
Loss = 1.4083e-02, PNorm = 800.1575, GNorm = 0.6268, lr_0 = 9.9446e-04
Validation auc = 0.696645
Epoch 7946
Loss = 3.8188e-02, PNorm = 800.1939, GNorm = 0.0590, lr_0 = 9.9446e-04
Validation auc = 0.695894
Epoch 7947
Loss = 4.4575e-02, PNorm = 800.2205, GNorm = 3.4416, lr_0 = 9.9446e-04
Validation auc = 0.693106
Epoch 7948
Loss = 7.6295e-03, PNorm = 800.2593, GNorm = 1.0114, lr_0 = 9.9446e-04
Validation auc = 0.690586
Epoch 7949
Loss = 2.7277e-02, PNorm = 800.3111, GNorm = 1.0637, lr_0 = 9.9446e-04
Loss = 2.8351e-02, PNorm = 800.3628, GNorm = 0.4532, lr_0 = 9.9446e-04
Validation auc = 0.690645
Epoch 7950
Loss = 4.2657e-02, PNorm = 800.4003, GNorm = 2.4546, lr_0 = 9.9445e-04
Validation auc = 0.694959
Epoch 7951
Loss = 4.6397e-02, PNorm = 800.4349, GNorm = 1.2915, lr_0 = 9.9445e-04
Validation auc = 0.694763
Epoch 7952
Loss = 3.0700e-02, PNorm = 800.4691, GNorm = 0.3299, lr_0 = 9.9445e-04
Validation auc = 0.697890
Epoch 7953
Loss = 3.4775e-02, PNorm = 800.5011, GNorm = 0.9059, lr_0 = 9.9445e-04
Validation auc = 0.698479
Epoch 7954
Loss = 5.5170e-02, PNorm = 800.5398, GNorm = 2.1611, lr_0 = 9.9445e-04
Validation auc = 0.695591
Epoch 7955
Loss = 4.2743e-02, PNorm = 800.5926, GNorm = 0.3872, lr_0 = 9.9445e-04
Validation auc = 0.699501
Epoch 7956
Loss = 4.5485e-02, PNorm = 800.6455, GNorm = 0.8998, lr_0 = 9.9445e-04
Validation auc = 0.700616
Epoch 7957
Loss = 6.9334e-02, PNorm = 800.6792, GNorm = 2.1343, lr_0 = 9.9445e-04
Validation auc = 0.708927
Epoch 7958
Loss = 4.6278e-02, PNorm = 800.7106, GNorm = 4.0316, lr_0 = 9.9445e-04
Validation auc = 0.708367
Epoch 7959
Loss = 8.5803e-03, PNorm = 800.7380, GNorm = 0.5403, lr_0 = 9.9445e-04
Loss = 2.6550e-02, PNorm = 800.7649, GNorm = 0.8849, lr_0 = 9.9445e-04
Validation auc = 0.709174
Epoch 7960
Loss = 6.1595e-02, PNorm = 800.7904, GNorm = 1.7904, lr_0 = 9.9445e-04
Validation auc = 0.707750
Epoch 7961
Loss = 1.4156e-02, PNorm = 800.8302, GNorm = 0.1048, lr_0 = 9.9445e-04
Validation auc = 0.700187
Epoch 7962
Loss = 7.3686e-02, PNorm = 800.8733, GNorm = 0.4099, lr_0 = 9.9445e-04
Validation auc = 0.695168
Epoch 7963
Loss = 4.3207e-02, PNorm = 800.9183, GNorm = 3.1000, lr_0 = 9.9444e-04
Validation auc = 0.689205
Epoch 7964
Loss = 3.1571e-02, PNorm = 800.9599, GNorm = 1.0918, lr_0 = 9.9444e-04
Validation auc = 0.689180
Epoch 7965
Loss = 7.5888e-02, PNorm = 800.9918, GNorm = 3.1675, lr_0 = 9.9444e-04
Validation auc = 0.688169
Epoch 7966
Loss = 5.4134e-02, PNorm = 801.0174, GNorm = 1.0152, lr_0 = 9.9444e-04
Validation auc = 0.686811
Epoch 7967
Loss = 1.6293e-02, PNorm = 801.0445, GNorm = 1.0094, lr_0 = 9.9444e-04
Validation auc = 0.685309
Epoch 7968
Loss = 4.7940e-03, PNorm = 801.0784, GNorm = 0.5236, lr_0 = 9.9444e-04
Validation auc = 0.687526
Epoch 7969
Loss = 3.6587e-02, PNorm = 801.1123, GNorm = 1.0810, lr_0 = 9.9444e-04
Loss = 3.3595e-02, PNorm = 801.1398, GNorm = 1.7626, lr_0 = 9.9444e-04
Validation auc = 0.694252
Epoch 7970
Loss = 2.6180e-02, PNorm = 801.1699, GNorm = 1.7372, lr_0 = 9.9444e-04
Validation auc = 0.693924
Epoch 7971
Loss = 1.9472e-02, PNorm = 801.1990, GNorm = 3.3011, lr_0 = 9.9444e-04
Validation auc = 0.690310
Epoch 7972
Loss = 5.2692e-02, PNorm = 801.2330, GNorm = 6.5157, lr_0 = 9.9444e-04
Validation auc = 0.689564
Epoch 7973
Loss = 3.3893e-02, PNorm = 801.2763, GNorm = 0.3177, lr_0 = 9.9444e-04
Validation auc = 0.689048
Epoch 7974
Loss = 2.6059e-02, PNorm = 801.3292, GNorm = 9.0428, lr_0 = 9.9444e-04
Validation auc = 0.688840
Epoch 7975
Loss = 3.0320e-02, PNorm = 801.3835, GNorm = 0.6759, lr_0 = 9.9444e-04
Validation auc = 0.688271
Epoch 7976
Loss = 7.9527e-02, PNorm = 801.4274, GNorm = 0.4756, lr_0 = 9.9444e-04
Validation auc = 0.683757
Epoch 7977
Loss = 9.7887e-02, PNorm = 801.4600, GNorm = 0.1279, lr_0 = 9.9443e-04
Validation auc = 0.681546
Epoch 7978
Loss = 1.5344e-02, PNorm = 801.4920, GNorm = 0.8701, lr_0 = 9.9443e-04
Validation auc = 0.682114
Epoch 7979
Loss = 1.5315e-03, PNorm = 801.5243, GNorm = 0.1135, lr_0 = 9.9443e-04
Loss = 1.2052e-02, PNorm = 801.5535, GNorm = 0.2294, lr_0 = 9.9443e-04
Validation auc = 0.684378
Epoch 7980
Loss = 3.8646e-02, PNorm = 801.5765, GNorm = 1.4817, lr_0 = 9.9443e-04
Validation auc = 0.690471
Epoch 7981
Loss = 1.3204e-02, PNorm = 801.6088, GNorm = 0.7547, lr_0 = 9.9443e-04
Validation auc = 0.691735
Epoch 7982
Loss = 4.7904e-02, PNorm = 801.6352, GNorm = 0.6579, lr_0 = 9.9443e-04
Validation auc = 0.692160
Epoch 7983
Loss = 1.2688e-02, PNorm = 801.6591, GNorm = 1.0988, lr_0 = 9.9443e-04
Validation auc = 0.692648
Epoch 7984
Loss = 1.4450e-01, PNorm = 801.6791, GNorm = 1.0124, lr_0 = 9.9443e-04
Validation auc = 0.696690
Epoch 7985
Loss = 2.4646e-02, PNorm = 801.7103, GNorm = 4.0151, lr_0 = 9.9443e-04
Validation auc = 0.695867
Epoch 7986
Loss = 3.1686e-02, PNorm = 801.7504, GNorm = 4.2508, lr_0 = 9.9443e-04
Validation auc = 0.682875
Epoch 7987
Loss = 4.9898e-02, PNorm = 801.7963, GNorm = 2.7412, lr_0 = 9.9443e-04
Validation auc = 0.679867
Epoch 7988
Loss = 1.0053e-02, PNorm = 801.8371, GNorm = 0.3602, lr_0 = 9.9443e-04
Validation auc = 0.682106
Epoch 7989
Loss = 9.1744e-03, PNorm = 801.8791, GNorm = 0.5868, lr_0 = 9.9443e-04
Loss = 3.4963e-02, PNorm = 801.9217, GNorm = 1.4549, lr_0 = 9.9442e-04
Validation auc = 0.686993
Epoch 7990
Loss = 3.6589e-02, PNorm = 801.9692, GNorm = 1.8723, lr_0 = 9.9442e-04
Validation auc = 0.690880
Epoch 7991
Loss = 4.6338e-02, PNorm = 802.0053, GNorm = 0.8678, lr_0 = 9.9442e-04
Validation auc = 0.692912
Epoch 7992
Loss = 2.4658e-02, PNorm = 802.0371, GNorm = 3.8818, lr_0 = 9.9442e-04
Validation auc = 0.693486
Epoch 7993
Loss = 4.3341e-02, PNorm = 802.0657, GNorm = 0.3403, lr_0 = 9.9442e-04
Validation auc = 0.699077
Epoch 7994
Loss = 2.0368e-02, PNorm = 802.0974, GNorm = 0.3465, lr_0 = 9.9442e-04
Validation auc = 0.700051
Epoch 7995
Loss = 2.4168e-02, PNorm = 802.1363, GNorm = 5.7679, lr_0 = 9.9442e-04
Validation auc = 0.693888
Epoch 7996
Loss = 6.0434e-02, PNorm = 802.1759, GNorm = 0.4817, lr_0 = 9.9442e-04
Validation auc = 0.686979
Epoch 7997
Loss = 3.4458e-02, PNorm = 802.2131, GNorm = 2.8437, lr_0 = 9.9442e-04
Validation auc = 0.690980
Epoch 7998
Loss = 1.5067e-02, PNorm = 802.2573, GNorm = 0.9790, lr_0 = 9.9442e-04
Validation auc = 0.698871
Epoch 7999
Loss = 5.0671e-02, PNorm = 802.3070, GNorm = 0.7834, lr_0 = 9.9442e-04
Loss = 4.9702e-02, PNorm = 802.3438, GNorm = 0.5532, lr_0 = 9.9442e-04
Validation auc = 0.702172
Epoch 8000
Loss = 1.1569e-01, PNorm = 802.4006, GNorm = 4.2713, lr_0 = 9.9442e-04
Validation auc = 0.702263
Epoch 8001
Loss = 6.5614e-02, PNorm = 802.4636, GNorm = 2.3074, lr_0 = 9.9442e-04
Validation auc = 0.708947
Epoch 8002
Loss = 3.1215e-02, PNorm = 802.5136, GNorm = 3.6408, lr_0 = 9.9442e-04
Validation auc = 0.711169
Epoch 8003
Loss = 3.2809e-01, PNorm = 802.5774, GNorm = 4.5009, lr_0 = 9.9441e-04
Validation auc = 0.707308
Epoch 8004
Loss = 1.2281e-01, PNorm = 802.6894, GNorm = 2.9828, lr_0 = 9.9441e-04
Validation auc = 0.701424
Epoch 8005
Loss = 5.3394e-02, PNorm = 802.7792, GNorm = 2.2372, lr_0 = 9.9441e-04
Validation auc = 0.706698
Epoch 8006
Loss = 5.4535e-02, PNorm = 802.8619, GNorm = 1.6631, lr_0 = 9.9441e-04
Validation auc = 0.707596
Epoch 8007
Loss = 4.3100e-02, PNorm = 802.9513, GNorm = 2.2731, lr_0 = 9.9441e-04
Validation auc = 0.692327
Epoch 8008
Loss = 1.1439e-01, PNorm = 803.0373, GNorm = 3.8162, lr_0 = 9.9441e-04
Validation auc = 0.698213
Epoch 8009
Loss = 1.8431e-01, PNorm = 803.1318, GNorm = 4.9830, lr_0 = 9.9441e-04
Loss = 1.0084e-01, PNorm = 803.2168, GNorm = 1.9825, lr_0 = 9.9441e-04
Validation auc = 0.702568
Epoch 8010
Loss = 9.0742e-02, PNorm = 803.2840, GNorm = 1.2803, lr_0 = 9.9441e-04
Validation auc = 0.705258
Epoch 8011
Loss = 7.4985e-02, PNorm = 803.3450, GNorm = 1.7696, lr_0 = 9.9441e-04
Validation auc = 0.703711
Epoch 8012
Loss = 5.1788e-02, PNorm = 803.4026, GNorm = 4.4603, lr_0 = 9.9441e-04
Validation auc = 0.702326
Epoch 8013
Loss = 2.4290e-02, PNorm = 803.4530, GNorm = 0.9970, lr_0 = 9.9441e-04
Validation auc = 0.706347
Epoch 8014
Loss = 3.2362e-02, PNorm = 803.5005, GNorm = 4.4165, lr_0 = 9.9441e-04
Validation auc = 0.712669
Epoch 8015
Loss = 8.6691e-02, PNorm = 803.5422, GNorm = 0.9588, lr_0 = 9.9441e-04
Validation auc = 0.719445
Epoch 8016
Loss = 4.6687e-02, PNorm = 803.5794, GNorm = 1.1765, lr_0 = 9.9441e-04
Validation auc = 0.721913
Epoch 8017
Loss = 2.0742e-02, PNorm = 803.6157, GNorm = 2.3618, lr_0 = 9.9440e-04
Validation auc = 0.720013
Epoch 8018
Loss = 3.1129e-02, PNorm = 803.6806, GNorm = 0.7043, lr_0 = 9.9440e-04
Validation auc = 0.717595
Epoch 8019
Loss = 3.2603e-02, PNorm = 803.7399, GNorm = 1.4028, lr_0 = 9.9440e-04
Loss = 8.5616e-02, PNorm = 803.7918, GNorm = 3.6565, lr_0 = 9.9440e-04
Validation auc = 0.719930
Epoch 8020
Loss = 5.4860e-02, PNorm = 803.8502, GNorm = 0.6197, lr_0 = 9.9440e-04
Validation auc = 0.720417
Epoch 8021
Loss = 5.2627e-02, PNorm = 803.8938, GNorm = 8.8012, lr_0 = 9.9440e-04
Validation auc = 0.718592
Epoch 8022
Loss = 7.3119e-02, PNorm = 803.9335, GNorm = 6.4881, lr_0 = 9.9440e-04
Validation auc = 0.725398
Epoch 8023
Loss = 3.6765e-02, PNorm = 803.9801, GNorm = 0.7937, lr_0 = 9.9440e-04
Validation auc = 0.729399
Epoch 8024
Loss = 5.0341e-02, PNorm = 804.0161, GNorm = 3.7887, lr_0 = 9.9440e-04
Validation auc = 0.725054
Epoch 8025
Loss = 9.6504e-02, PNorm = 804.0474, GNorm = 6.8721, lr_0 = 9.9440e-04
Validation auc = 0.721405
Epoch 8026
Loss = 1.8625e-02, PNorm = 804.0907, GNorm = 0.6213, lr_0 = 9.9440e-04
Validation auc = 0.716463
Epoch 8027
Loss = 4.2402e-02, PNorm = 804.1319, GNorm = 1.2399, lr_0 = 9.9440e-04
Validation auc = 0.723348
Epoch 8028
Loss = 6.3112e-02, PNorm = 804.1695, GNorm = 2.5311, lr_0 = 9.9440e-04
Validation auc = 0.730853
Epoch 8029
Loss = 1.8136e-02, PNorm = 804.2171, GNorm = 0.7923, lr_0 = 9.9440e-04
Loss = 3.8247e-02, PNorm = 804.2596, GNorm = 0.8867, lr_0 = 9.9439e-04
Validation auc = 0.730291
Epoch 8030
Loss = 1.0496e-01, PNorm = 804.2907, GNorm = 4.6487, lr_0 = 9.9439e-04
Validation auc = 0.726134
Epoch 8031
Loss = 5.7231e-02, PNorm = 804.3435, GNorm = 1.8547, lr_0 = 9.9439e-04
Validation auc = 0.722026
Epoch 8032
Loss = 3.1303e-02, PNorm = 804.3920, GNorm = 2.3760, lr_0 = 9.9439e-04
Validation auc = 0.724599
Epoch 8033
Loss = 4.3207e-02, PNorm = 804.4323, GNorm = 2.9209, lr_0 = 9.9439e-04
Validation auc = 0.724683
Epoch 8034
Loss = 9.7381e-02, PNorm = 804.4658, GNorm = 5.7590, lr_0 = 9.9439e-04
Validation auc = 0.718933
Epoch 8035
Loss = 4.0276e-02, PNorm = 804.5037, GNorm = 0.6437, lr_0 = 9.9439e-04
Validation auc = 0.717585
Epoch 8036
Loss = 1.6411e-01, PNorm = 804.5407, GNorm = 21.9808, lr_0 = 9.9439e-04
Validation auc = 0.716325
Epoch 8037
Loss = 5.9543e-02, PNorm = 804.5981, GNorm = 2.5190, lr_0 = 9.9439e-04
Validation auc = 0.714317
Epoch 8038
Loss = 5.5571e-02, PNorm = 804.6640, GNorm = 0.8530, lr_0 = 9.9439e-04
Validation auc = 0.715304
Epoch 8039
Loss = 2.1858e-01, PNorm = 804.7336, GNorm = 5.3630, lr_0 = 9.9439e-04
Loss = 5.4064e-02, PNorm = 804.7932, GNorm = 2.6810, lr_0 = 9.9439e-04
Validation auc = 0.710181
Epoch 8040
Loss = 7.5645e-02, PNorm = 804.8466, GNorm = 2.0264, lr_0 = 9.9439e-04
Validation auc = 0.708619
Epoch 8041
Loss = 6.0969e-02, PNorm = 804.8979, GNorm = 1.5500, lr_0 = 9.9439e-04
Validation auc = 0.710571
Epoch 8042
Loss = 8.6810e-02, PNorm = 804.9570, GNorm = 8.1324, lr_0 = 9.9439e-04
Validation auc = 0.713625
Epoch 8043
Loss = 4.6968e-02, PNorm = 805.0156, GNorm = 0.1939, lr_0 = 9.9438e-04
Validation auc = 0.715673
Epoch 8044
Loss = 3.6318e-02, PNorm = 805.0584, GNorm = 1.6372, lr_0 = 9.9438e-04
Validation auc = 0.716606
Epoch 8045
Loss = 4.7146e-02, PNorm = 805.0922, GNorm = 3.8277, lr_0 = 9.9438e-04
Validation auc = 0.718564
Epoch 8046
Loss = 3.6539e-02, PNorm = 805.1320, GNorm = 2.6088, lr_0 = 9.9438e-04
Validation auc = 0.720688
Epoch 8047
Loss = 3.7449e-02, PNorm = 805.1683, GNorm = 1.5266, lr_0 = 9.9438e-04
Validation auc = 0.720174
Epoch 8048
Loss = 4.1555e-02, PNorm = 805.2087, GNorm = 0.6331, lr_0 = 9.9438e-04
Validation auc = 0.716850
Epoch 8049
Loss = 9.0471e-02, PNorm = 805.2482, GNorm = 1.9185, lr_0 = 9.9438e-04
Loss = 3.7827e-02, PNorm = 805.2971, GNorm = 1.0192, lr_0 = 9.9438e-04
Validation auc = 0.717590
Epoch 8050
Loss = 1.5868e-02, PNorm = 805.3388, GNorm = 0.2340, lr_0 = 9.9438e-04
Validation auc = 0.719519
Epoch 8051
Loss = 5.2707e-02, PNorm = 805.3783, GNorm = 2.1816, lr_0 = 9.9438e-04
Validation auc = 0.719945
Epoch 8052
Loss = 6.7794e-02, PNorm = 805.4179, GNorm = 1.6620, lr_0 = 9.9438e-04
Validation auc = 0.720173
Epoch 8053
Loss = 3.8754e-02, PNorm = 805.5508, GNorm = 0.9424, lr_0 = 9.9438e-04
Validation auc = 0.715125
Epoch 8054
Loss = 4.5921e-02, PNorm = 805.6403, GNorm = 5.2121, lr_0 = 9.9438e-04
Validation auc = 0.713769
Epoch 8055
Loss = 4.5705e-02, PNorm = 805.6989, GNorm = 2.9958, lr_0 = 9.9438e-04
Validation auc = 0.717041
Epoch 8056
Loss = 2.0328e-01, PNorm = 805.7446, GNorm = 2.2616, lr_0 = 9.9437e-04
Validation auc = 0.717660
Epoch 8057
Loss = 9.4893e-02, PNorm = 805.7912, GNorm = 5.6718, lr_0 = 9.9437e-04
Validation auc = 0.711883
Epoch 8058
Loss = 1.9327e-01, PNorm = 805.8445, GNorm = 16.9237, lr_0 = 9.9437e-04
Validation auc = 0.717438
Epoch 8059
Loss = 3.2509e-02, PNorm = 805.9111, GNorm = 1.1767, lr_0 = 9.9437e-04
Loss = 4.6386e-02, PNorm = 805.9651, GNorm = 0.8065, lr_0 = 9.9437e-04
Validation auc = 0.713346
Epoch 8060
Loss = 8.6946e-02, PNorm = 806.0104, GNorm = 16.1643, lr_0 = 9.9437e-04
Validation auc = 0.707905
Epoch 8061
Loss = 3.8556e-02, PNorm = 806.0610, GNorm = 0.8875, lr_0 = 9.9437e-04
Validation auc = 0.696936
Epoch 8062
Loss = 7.4909e-02, PNorm = 806.1098, GNorm = 0.5188, lr_0 = 9.9437e-04
Validation auc = 0.699372
Epoch 8063
Loss = 4.2487e-02, PNorm = 806.1567, GNorm = 1.0598, lr_0 = 9.9437e-04
Validation auc = 0.699638
Epoch 8064
Loss = 5.4050e-02, PNorm = 806.1915, GNorm = 1.9024, lr_0 = 9.9437e-04
Validation auc = 0.707210
Epoch 8065
Loss = 2.6458e-02, PNorm = 806.2230, GNorm = 0.3028, lr_0 = 9.9437e-04
Validation auc = 0.713162
Epoch 8066
Loss = 2.2659e-02, PNorm = 806.2476, GNorm = 0.9771, lr_0 = 9.9437e-04
Validation auc = 0.715824
Epoch 8067
Loss = 9.3882e-03, PNorm = 806.2805, GNorm = 0.7651, lr_0 = 9.9437e-04
Validation auc = 0.718095
Epoch 8068
Loss = 2.3093e-02, PNorm = 806.3135, GNorm = 0.8428, lr_0 = 9.9437e-04
Validation auc = 0.719968
Epoch 8069
Loss = 1.6056e-02, PNorm = 806.3454, GNorm = 1.4277, lr_0 = 9.9437e-04
Loss = 3.6126e-02, PNorm = 806.3777, GNorm = 0.3108, lr_0 = 9.9436e-04
Validation auc = 0.725329
Epoch 8070
Loss = 5.6425e-02, PNorm = 806.4062, GNorm = 2.6480, lr_0 = 9.9436e-04
Validation auc = 0.728310
Epoch 8071
Loss = 7.0665e-02, PNorm = 806.4464, GNorm = 1.8830, lr_0 = 9.9436e-04
Validation auc = 0.731556
Epoch 8072
Loss = 9.3203e-02, PNorm = 806.4890, GNorm = 4.6461, lr_0 = 9.9436e-04
Validation auc = 0.730093
Epoch 8073
Loss = 8.1004e-02, PNorm = 806.5363, GNorm = 2.5619, lr_0 = 9.9436e-04
Validation auc = 0.729385
Epoch 8074
Loss = 6.4794e-02, PNorm = 806.6446, GNorm = 1.8643, lr_0 = 9.9436e-04
Validation auc = 0.724351
Epoch 8075
Loss = 1.2550e-01, PNorm = 806.7521, GNorm = 2.5928, lr_0 = 9.9436e-04
Validation auc = 0.717044
Epoch 8076
Loss = 1.3513e-01, PNorm = 806.8372, GNorm = 3.9984, lr_0 = 9.9436e-04
Validation auc = 0.714410
Epoch 8077
Loss = 7.3281e-02, PNorm = 806.9150, GNorm = 1.9125, lr_0 = 9.9436e-04
Validation auc = 0.714228
Epoch 8078
Loss = 2.3811e-02, PNorm = 806.9845, GNorm = 0.5039, lr_0 = 9.9436e-04
Validation auc = 0.717475
Epoch 8079
Loss = 5.6987e-02, PNorm = 807.0412, GNorm = 2.0950, lr_0 = 9.9436e-04
Loss = 5.7420e-02, PNorm = 807.0897, GNorm = 3.3180, lr_0 = 9.9436e-04
Validation auc = 0.721286
Epoch 8080
Loss = 5.3033e-02, PNorm = 807.1335, GNorm = 4.2370, lr_0 = 9.9436e-04
Validation auc = 0.724203
Epoch 8081
Loss = 5.7077e-02, PNorm = 807.1755, GNorm = 2.1165, lr_0 = 9.9436e-04
Validation auc = 0.722414
Epoch 8082
Loss = 5.8282e-02, PNorm = 807.2191, GNorm = 1.7397, lr_0 = 9.9436e-04
Validation auc = 0.718565
Epoch 8083
Loss = 3.3491e-02, PNorm = 807.2635, GNorm = 2.0057, lr_0 = 9.9435e-04
Validation auc = 0.714215
Epoch 8084
Loss = 4.6034e-02, PNorm = 807.3024, GNorm = 0.4474, lr_0 = 9.9435e-04
Validation auc = 0.711095
Epoch 8085
Loss = 5.6048e-02, PNorm = 807.3363, GNorm = 3.9197, lr_0 = 9.9435e-04
Validation auc = 0.710091
Epoch 8086
Loss = 2.6994e-02, PNorm = 807.3667, GNorm = 2.8813, lr_0 = 9.9435e-04
Validation auc = 0.711970
Epoch 8087
Loss = 4.2239e-02, PNorm = 807.3954, GNorm = 1.9526, lr_0 = 9.9435e-04
Validation auc = 0.710435
Epoch 8088
Loss = 2.7022e-02, PNorm = 807.4346, GNorm = 0.9606, lr_0 = 9.9435e-04
Validation auc = 0.709083
Epoch 8089
Loss = 5.8957e-02, PNorm = 807.4804, GNorm = 2.0405, lr_0 = 9.9435e-04
Loss = 4.0503e-02, PNorm = 807.5197, GNorm = 0.6889, lr_0 = 9.9435e-04
Validation auc = 0.712340
Epoch 8090
Loss = 6.0638e-02, PNorm = 807.5594, GNorm = 4.1832, lr_0 = 9.9435e-04
Validation auc = 0.713954
Epoch 8091
Loss = 6.5935e-02, PNorm = 807.6042, GNorm = 1.2834, lr_0 = 9.9435e-04
Validation auc = 0.714347
Epoch 8092
Loss = 5.8070e-02, PNorm = 807.6499, GNorm = 3.8648, lr_0 = 9.9435e-04
Validation auc = 0.718618
Epoch 8093
Loss = 8.2244e-02, PNorm = 807.6931, GNorm = 1.4487, lr_0 = 9.9435e-04
Validation auc = 0.715622
Epoch 8094
Loss = 2.3003e-02, PNorm = 807.7351, GNorm = 0.4897, lr_0 = 9.9435e-04
Validation auc = 0.712305
Epoch 8095
Loss = 4.1478e-02, PNorm = 807.7706, GNorm = 0.5707, lr_0 = 9.9435e-04
Validation auc = 0.713320
Epoch 8096
Loss = 1.1542e-01, PNorm = 807.8025, GNorm = 0.1784, lr_0 = 9.9434e-04
Validation auc = 0.709209
Epoch 8097
Loss = 6.7072e-02, PNorm = 807.8453, GNorm = 3.5062, lr_0 = 9.9434e-04
Validation auc = 0.708674
Epoch 8098
Loss = 1.4840e-02, PNorm = 807.8808, GNorm = 1.6767, lr_0 = 9.9434e-04
Validation auc = 0.707004
Epoch 8099
Loss = 1.1996e-02, PNorm = 807.9148, GNorm = 0.5643, lr_0 = 9.9434e-04
Loss = 4.8599e-02, PNorm = 807.9482, GNorm = 1.0935, lr_0 = 9.9434e-04
Validation auc = 0.705816
Epoch 8100
Loss = 2.0510e-02, PNorm = 807.9754, GNorm = 0.3445, lr_0 = 9.9434e-04
Validation auc = 0.705499
Epoch 8101
Loss = 2.5555e-02, PNorm = 808.0000, GNorm = 0.9962, lr_0 = 9.9434e-04
Validation auc = 0.705759
Epoch 8102
Loss = 4.5674e-02, PNorm = 808.0232, GNorm = 0.1695, lr_0 = 9.9434e-04
Validation auc = 0.699398
Epoch 8103
Loss = 7.6961e-02, PNorm = 808.0588, GNorm = 3.3951, lr_0 = 9.9434e-04
Validation auc = 0.696820
Epoch 8104
Loss = 2.0882e-02, PNorm = 808.1041, GNorm = 1.9569, lr_0 = 9.9434e-04
Validation auc = 0.691733
Epoch 8105
Loss = 3.3215e-02, PNorm = 808.1414, GNorm = 1.5492, lr_0 = 9.9434e-04
Validation auc = 0.697648
Epoch 8106
Loss = 4.7851e-02, PNorm = 808.1784, GNorm = 3.8263, lr_0 = 9.9434e-04
Validation auc = 0.700956
Epoch 8107
Loss = 6.3294e-02, PNorm = 808.2165, GNorm = 3.5446, lr_0 = 9.9434e-04
Validation auc = 0.698920
Epoch 8108
Loss = 1.0930e-01, PNorm = 808.2569, GNorm = 7.3557, lr_0 = 9.9434e-04
Validation auc = 0.700424
Epoch 8109
Loss = 2.5144e-01, PNorm = 808.3051, GNorm = 9.7669, lr_0 = 9.9434e-04
Loss = 2.4942e-01, PNorm = 808.3872, GNorm = 0.6931, lr_0 = 9.9433e-04
Validation auc = 0.711226
Epoch 8110
Loss = 5.3175e-02, PNorm = 808.4991, GNorm = 0.7120, lr_0 = 9.9433e-04
Validation auc = 0.705351
Epoch 8111
Loss = 5.8742e-02, PNorm = 808.5694, GNorm = 1.3544, lr_0 = 9.9433e-04
Validation auc = 0.702389
Epoch 8112
Loss = 6.0627e-02, PNorm = 808.6319, GNorm = 2.3744, lr_0 = 9.9433e-04
Validation auc = 0.700088
Epoch 8113
Loss = 6.7974e-02, PNorm = 808.6911, GNorm = 6.7268, lr_0 = 9.9433e-04
Validation auc = 0.699833
Epoch 8114
Loss = 5.0223e-02, PNorm = 808.7512, GNorm = 1.0600, lr_0 = 9.9433e-04
Validation auc = 0.700074
Epoch 8115
Loss = 6.1793e-02, PNorm = 808.8069, GNorm = 3.9893, lr_0 = 9.9433e-04
Validation auc = 0.694756
Epoch 8116
Loss = 5.4503e-02, PNorm = 808.8570, GNorm = 1.2826, lr_0 = 9.9433e-04
Validation auc = 0.694874
Epoch 8117
Loss = 5.5077e-02, PNorm = 808.9050, GNorm = 4.0799, lr_0 = 9.9433e-04
Validation auc = 0.697058
Epoch 8118
Loss = 2.2299e-02, PNorm = 808.9543, GNorm = 0.2618, lr_0 = 9.9433e-04
Validation auc = 0.700087
Epoch 8119
Loss = 2.2982e-02, PNorm = 809.0021, GNorm = 0.9164, lr_0 = 9.9433e-04
Loss = 4.7281e-02, PNorm = 809.0453, GNorm = 0.4343, lr_0 = 9.9433e-04
Validation auc = 0.705866
Epoch 8120
Loss = 7.2058e-02, PNorm = 809.1009, GNorm = 2.8704, lr_0 = 9.9433e-04
Validation auc = 0.710872
Epoch 8121
Loss = 3.2013e-02, PNorm = 809.1480, GNorm = 2.6512, lr_0 = 9.9433e-04
Validation auc = 0.713233
Epoch 8122
Loss = 3.7560e-02, PNorm = 809.1873, GNorm = 2.6932, lr_0 = 9.9432e-04
Validation auc = 0.708606
Epoch 8123
Loss = 6.4930e-02, PNorm = 809.2270, GNorm = 6.5692, lr_0 = 9.9432e-04
Validation auc = 0.703370
Epoch 8124
Loss = 1.4698e-01, PNorm = 809.2622, GNorm = 1.0401, lr_0 = 9.9432e-04
Validation auc = 0.697132
Epoch 8125
Loss = 2.0301e-02, PNorm = 809.3111, GNorm = 0.9595, lr_0 = 9.9432e-04
Validation auc = 0.701631
Epoch 8126
Loss = 5.0783e-02, PNorm = 809.3540, GNorm = 0.5180, lr_0 = 9.9432e-04
Validation auc = 0.701295
Epoch 8127
Loss = 9.8990e-02, PNorm = 809.3961, GNorm = 1.8200, lr_0 = 9.9432e-04
Validation auc = 0.701355
Epoch 8128
Loss = 1.0488e-01, PNorm = 809.4388, GNorm = 21.5877, lr_0 = 9.9432e-04
Validation auc = 0.706589
Epoch 8129
Loss = 1.4521e-01, PNorm = 809.4876, GNorm = 4.8523, lr_0 = 9.9432e-04
Loss = 4.6221e-02, PNorm = 809.5358, GNorm = 0.2554, lr_0 = 9.9432e-04
Validation auc = 0.707471
Epoch 8130
Loss = 5.3701e-02, PNorm = 809.5907, GNorm = 0.3788, lr_0 = 9.9432e-04
Validation auc = 0.712209
Epoch 8131
Loss = 4.8940e-02, PNorm = 809.6352, GNorm = 4.1537, lr_0 = 9.9432e-04
Validation auc = 0.716784
Epoch 8132
Loss = 3.0321e-02, PNorm = 809.6683, GNorm = 1.3738, lr_0 = 9.9432e-04
Validation auc = 0.724046
Epoch 8133
Loss = 4.3935e-02, PNorm = 809.6978, GNorm = 5.4996, lr_0 = 9.9432e-04
Validation auc = 0.723511
Epoch 8134
Loss = 3.0140e-02, PNorm = 809.7311, GNorm = 1.6139, lr_0 = 9.9432e-04
Validation auc = 0.718980
Epoch 8135
Loss = 4.6457e-02, PNorm = 809.7681, GNorm = 0.3317, lr_0 = 9.9432e-04
Validation auc = 0.714280
Epoch 8136
Loss = 5.9904e-02, PNorm = 809.8187, GNorm = 0.8360, lr_0 = 9.9431e-04
Validation auc = 0.712948
Epoch 8137
Loss = 1.7408e-02, PNorm = 809.8667, GNorm = 1.5314, lr_0 = 9.9431e-04
Validation auc = 0.716281
Epoch 8138
Loss = 2.5668e-02, PNorm = 809.9052, GNorm = 1.1771, lr_0 = 9.9431e-04
Validation auc = 0.718235
Epoch 8139
Loss = 1.2434e-02, PNorm = 809.9393, GNorm = 0.6123, lr_0 = 9.9431e-04
Loss = 6.6524e-02, PNorm = 809.9842, GNorm = 2.7207, lr_0 = 9.9431e-04
Validation auc = 0.716056
Epoch 8140
Loss = 4.1567e-02, PNorm = 810.0276, GNorm = 1.4490, lr_0 = 9.9431e-04
Validation auc = 0.709637
Epoch 8141
Loss = 8.9071e-02, PNorm = 810.0664, GNorm = 2.6094, lr_0 = 9.9431e-04
Validation auc = 0.708070
Epoch 8142
Loss = 3.4301e-02, PNorm = 810.1107, GNorm = 0.5505, lr_0 = 9.9431e-04
Validation auc = 0.707952
Epoch 8143
Loss = 8.9356e-02, PNorm = 810.1662, GNorm = 4.1308, lr_0 = 9.9431e-04
Validation auc = 0.703331
Epoch 8144
Loss = 4.3457e-02, PNorm = 810.2298, GNorm = 3.7546, lr_0 = 9.9431e-04
Validation auc = 0.701783
Epoch 8145
Loss = 1.7012e-02, PNorm = 810.2763, GNorm = 0.5597, lr_0 = 9.9431e-04
Validation auc = 0.701424
Epoch 8146
Loss = 9.4561e-03, PNorm = 810.3084, GNorm = 0.1458, lr_0 = 9.9431e-04
Validation auc = 0.702844
Epoch 8147
Loss = 2.2525e-02, PNorm = 810.3333, GNorm = 0.1989, lr_0 = 9.9431e-04
Validation auc = 0.701476
Epoch 8148
Loss = 2.1439e-02, PNorm = 810.3644, GNorm = 1.4478, lr_0 = 9.9431e-04
Validation auc = 0.700012
Epoch 8149
Loss = 1.3292e-02, PNorm = 810.4023, GNorm = 1.2879, lr_0 = 9.9431e-04
Loss = 3.2484e-02, PNorm = 810.4448, GNorm = 1.6557, lr_0 = 9.9430e-04
Validation auc = 0.696840
Epoch 8150
Loss = 7.5308e-02, PNorm = 810.4831, GNorm = 1.6422, lr_0 = 9.9430e-04
Validation auc = 0.696290
Epoch 8151
Loss = 1.9277e-02, PNorm = 810.5136, GNorm = 1.4806, lr_0 = 9.9430e-04
Validation auc = 0.695400
Epoch 8152
Loss = 4.1371e-02, PNorm = 810.5437, GNorm = 1.0287, lr_0 = 9.9430e-04
Validation auc = 0.695600
Epoch 8153
Loss = 1.9412e-02, PNorm = 810.5778, GNorm = 1.4536, lr_0 = 9.9430e-04
Validation auc = 0.697657
Epoch 8154
Loss = 1.7935e-02, PNorm = 810.6064, GNorm = 0.9941, lr_0 = 9.9430e-04
Validation auc = 0.699072
Epoch 8155
Loss = 8.6813e-03, PNorm = 810.6320, GNorm = 0.9737, lr_0 = 9.9430e-04
Validation auc = 0.694144
Epoch 8156
Loss = 3.0746e-02, PNorm = 810.6622, GNorm = 1.3337, lr_0 = 9.9430e-04
Validation auc = 0.689275
Epoch 8157
Loss = 3.4665e-02, PNorm = 810.7001, GNorm = 3.7642, lr_0 = 9.9430e-04
Validation auc = 0.690033
Epoch 8158
Loss = 9.8380e-03, PNorm = 810.7368, GNorm = 0.7775, lr_0 = 9.9430e-04
Validation auc = 0.694912
Epoch 8159
Loss = 8.8579e-03, PNorm = 810.7716, GNorm = 0.4319, lr_0 = 9.9430e-04
Loss = 3.2521e-02, PNorm = 810.8115, GNorm = 3.3892, lr_0 = 9.9430e-04
Validation auc = 0.702385
Epoch 8160
Loss = 4.2874e-02, PNorm = 810.8418, GNorm = 5.7932, lr_0 = 9.9430e-04
Validation auc = 0.707600
Epoch 8161
Loss = 2.4821e-02, PNorm = 810.8710, GNorm = 5.6248, lr_0 = 9.9430e-04
Validation auc = 0.706811
Epoch 8162
Loss = 2.4813e-02, PNorm = 810.9057, GNorm = 0.3388, lr_0 = 9.9429e-04
Validation auc = 0.698735
Epoch 8163
Loss = 6.2596e-02, PNorm = 810.9368, GNorm = 6.4761, lr_0 = 9.9429e-04
Validation auc = 0.693500
Epoch 8164
Loss = 2.8844e-02, PNorm = 810.9800, GNorm = 0.7479, lr_0 = 9.9429e-04
Validation auc = 0.690047
Epoch 8165
Loss = 2.1376e-02, PNorm = 811.0246, GNorm = 1.4969, lr_0 = 9.9429e-04
Validation auc = 0.690950
Epoch 8166
Loss = 5.2405e-02, PNorm = 811.0747, GNorm = 4.2616, lr_0 = 9.9429e-04
Validation auc = 0.704813
Epoch 8167
Loss = 1.1701e-02, PNorm = 811.1214, GNorm = 0.1481, lr_0 = 9.9429e-04
Validation auc = 0.705544
Epoch 8168
Loss = 5.6965e-02, PNorm = 811.1678, GNorm = 2.1050, lr_0 = 9.9429e-04
Validation auc = 0.706604
Epoch 8169
Loss = 2.7479e-03, PNorm = 811.2085, GNorm = 0.2274, lr_0 = 9.9429e-04
Loss = 5.6662e-02, PNorm = 811.2511, GNorm = 3.5882, lr_0 = 9.9429e-04
Validation auc = 0.708106
Epoch 8170
Loss = 5.0502e-02, PNorm = 811.2894, GNorm = 0.8969, lr_0 = 9.9429e-04
Validation auc = 0.712829
Epoch 8171
Loss = 3.7881e-02, PNorm = 811.3263, GNorm = 1.2875, lr_0 = 9.9429e-04
Validation auc = 0.717045
Epoch 8172
Loss = 5.3866e-02, PNorm = 811.3604, GNorm = 1.7969, lr_0 = 9.9429e-04
Validation auc = 0.721185
Epoch 8173
Loss = 4.6039e-02, PNorm = 811.3994, GNorm = 6.0550, lr_0 = 9.9429e-04
Validation auc = 0.716698
Epoch 8174
Loss = 5.1562e-02, PNorm = 811.4451, GNorm = 5.9207, lr_0 = 9.9429e-04
Validation auc = 0.712785
Epoch 8175
Loss = 3.3582e-02, PNorm = 811.4894, GNorm = 0.8529, lr_0 = 9.9429e-04
Validation auc = 0.707946
Epoch 8176
Loss = 9.6558e-02, PNorm = 811.5334, GNorm = 0.3052, lr_0 = 9.9428e-04
Validation auc = 0.702833
Epoch 8177
Loss = 5.3701e-02, PNorm = 811.5878, GNorm = 2.2438, lr_0 = 9.9428e-04
Validation auc = 0.689137
Epoch 8178
Loss = 3.1577e-02, PNorm = 811.6426, GNorm = 2.0386, lr_0 = 9.9428e-04
Validation auc = 0.681446
Epoch 8179
Loss = 8.7410e-03, PNorm = 811.6957, GNorm = 0.6358, lr_0 = 9.9428e-04
Loss = 3.7275e-02, PNorm = 811.7429, GNorm = 2.2627, lr_0 = 9.9428e-04
Validation auc = 0.680728
Epoch 8180
Loss = 3.4041e-02, PNorm = 811.7768, GNorm = 0.5384, lr_0 = 9.9428e-04
Validation auc = 0.682263
Epoch 8181
Loss = 3.8692e-02, PNorm = 811.8085, GNorm = 2.6668, lr_0 = 9.9428e-04
Validation auc = 0.684854
Epoch 8182
Loss = 2.4522e-02, PNorm = 811.8331, GNorm = 2.3823, lr_0 = 9.9428e-04
Validation auc = 0.687161
Epoch 8183
Loss = 1.2463e-02, PNorm = 811.8622, GNorm = 1.2116, lr_0 = 9.9428e-04
Validation auc = 0.687244
Epoch 8184
Loss = 3.6064e-02, PNorm = 811.8855, GNorm = 0.1492, lr_0 = 9.9428e-04
Validation auc = 0.684208
Epoch 8185
Loss = 3.5459e-02, PNorm = 811.9079, GNorm = 0.3754, lr_0 = 9.9428e-04
Validation auc = 0.680714
Epoch 8186
Loss = 6.7355e-02, PNorm = 811.9308, GNorm = 10.1036, lr_0 = 9.9428e-04
Validation auc = 0.679305
Epoch 8187
Loss = 1.1355e-02, PNorm = 811.9569, GNorm = 1.3005, lr_0 = 9.9428e-04
Validation auc = 0.686084
Epoch 8188
Loss = 6.3354e-02, PNorm = 811.9819, GNorm = 1.6950, lr_0 = 9.9428e-04
Validation auc = 0.674894
Epoch 8189
Loss = 4.1643e-02, PNorm = 812.0375, GNorm = 3.7432, lr_0 = 9.9427e-04
Loss = 6.7223e-02, PNorm = 812.1200, GNorm = 2.1119, lr_0 = 9.9427e-04
Validation auc = 0.669088
Epoch 8190
Loss = 1.7291e-01, PNorm = 812.2113, GNorm = 9.5138, lr_0 = 9.9427e-04
Validation auc = 0.655840
Epoch 8191
Loss = 1.5597e-01, PNorm = 812.3056, GNorm = 6.3656, lr_0 = 9.9427e-04
Validation auc = 0.655542
Epoch 8192
Loss = 1.2157e-01, PNorm = 812.3960, GNorm = 2.7457, lr_0 = 9.9427e-04
Validation auc = 0.648255
Epoch 8193
Loss = 1.5796e-01, PNorm = 812.4768, GNorm = 9.9423, lr_0 = 9.9427e-04
Validation auc = 0.644008
Epoch 8194
Loss = 8.2280e-02, PNorm = 812.5437, GNorm = 0.9460, lr_0 = 9.9427e-04
Validation auc = 0.636149
Epoch 8195
Loss = 4.7564e-02, PNorm = 812.6048, GNorm = 4.8774, lr_0 = 9.9427e-04
Validation auc = 0.636996
Epoch 8196
Loss = 3.7476e-02, PNorm = 812.6562, GNorm = 5.2702, lr_0 = 9.9427e-04
Validation auc = 0.638112
Epoch 8197
Loss = 5.4324e-02, PNorm = 812.7023, GNorm = 4.2944, lr_0 = 9.9427e-04
Validation auc = 0.640768
Epoch 8198
Loss = 7.4222e-02, PNorm = 812.7596, GNorm = 4.5543, lr_0 = 9.9427e-04
Validation auc = 0.637779
Epoch 8199
Loss = 8.3026e-02, PNorm = 812.8193, GNorm = 1.9181, lr_0 = 9.9427e-04
Loss = 6.2313e-02, PNorm = 812.8683, GNorm = 0.5207, lr_0 = 9.9427e-04
Validation auc = 0.640263
Epoch 8200
Loss = 1.4423e-01, PNorm = 812.9271, GNorm = 1.5119, lr_0 = 9.9427e-04
Validation auc = 0.647988
Epoch 8201
Loss = 5.9262e-02, PNorm = 812.9889, GNorm = 0.5319, lr_0 = 9.9427e-04
Validation auc = 0.656782
Epoch 8202
Loss = 9.3939e-02, PNorm = 813.0549, GNorm = 2.6307, lr_0 = 9.9426e-04
Validation auc = 0.657313
Epoch 8203
Loss = 9.3557e-02, PNorm = 813.1276, GNorm = 0.6447, lr_0 = 9.9426e-04
Validation auc = 0.651793
Epoch 8204
Loss = 3.6759e-02, PNorm = 813.1816, GNorm = 1.1133, lr_0 = 9.9426e-04
Validation auc = 0.651642
Epoch 8205
Loss = 7.2009e-02, PNorm = 813.2186, GNorm = 1.2551, lr_0 = 9.9426e-04
Validation auc = 0.649756
Epoch 8206
Loss = 3.7734e-02, PNorm = 813.2521, GNorm = 2.4114, lr_0 = 9.9426e-04
Validation auc = 0.651204
Epoch 8207
Loss = 5.4364e-02, PNorm = 813.2822, GNorm = 1.9372, lr_0 = 9.9426e-04
Validation auc = 0.653342
Epoch 8208
Loss = 5.6596e-03, PNorm = 813.3216, GNorm = 0.1435, lr_0 = 9.9426e-04
Validation auc = 0.658923
Epoch 8209
Loss = 1.5029e-01, PNorm = 813.3559, GNorm = 6.3034, lr_0 = 9.9426e-04
Loss = 5.0110e-02, PNorm = 813.3863, GNorm = 0.3676, lr_0 = 9.9426e-04
Validation auc = 0.659476
Epoch 8210
Loss = 2.8210e-02, PNorm = 813.4224, GNorm = 1.0124, lr_0 = 9.9426e-04
Validation auc = 0.656878
Epoch 8211
Loss = 6.6275e-02, PNorm = 813.4513, GNorm = 3.0684, lr_0 = 9.9426e-04
Validation auc = 0.656591
Epoch 8212
Loss = 3.5961e-02, PNorm = 813.4876, GNorm = 0.2329, lr_0 = 9.9426e-04
Validation auc = 0.658654
Epoch 8213
Loss = 7.5348e-02, PNorm = 813.5284, GNorm = 0.8466, lr_0 = 9.9426e-04
Validation auc = 0.657358
Epoch 8214
Loss = 4.5574e-02, PNorm = 813.5706, GNorm = 1.1882, lr_0 = 9.9426e-04
Validation auc = 0.660711
Epoch 8215
Loss = 3.1339e-02, PNorm = 813.6103, GNorm = 0.2556, lr_0 = 9.9426e-04
Validation auc = 0.662929
Epoch 8216
Loss = 1.5257e-02, PNorm = 813.6472, GNorm = 5.7891, lr_0 = 9.9425e-04
Validation auc = 0.664911
Epoch 8217
Loss = 1.0763e-02, PNorm = 813.6868, GNorm = 0.8575, lr_0 = 9.9425e-04
Validation auc = 0.667386
Epoch 8218
Loss = 1.5536e-02, PNorm = 813.7210, GNorm = 0.8320, lr_0 = 9.9425e-04
Validation auc = 0.670330
Epoch 8219
Loss = 3.4146e-03, PNorm = 813.7450, GNorm = 0.2454, lr_0 = 9.9425e-04
Loss = 2.5366e-02, PNorm = 813.7788, GNorm = 0.2669, lr_0 = 9.9425e-04
Validation auc = 0.669324
Epoch 8220
Loss = 5.9523e-02, PNorm = 813.8235, GNorm = 3.2857, lr_0 = 9.9425e-04
Validation auc = 0.674450
Epoch 8221
Loss = 3.8352e-02, PNorm = 813.8767, GNorm = 1.0989, lr_0 = 9.9425e-04
Validation auc = 0.673501
Epoch 8222
Loss = 1.0522e-01, PNorm = 813.9213, GNorm = 0.7929, lr_0 = 9.9425e-04
Validation auc = 0.668921
Epoch 8223
Loss = 1.6740e-02, PNorm = 813.9574, GNorm = 1.9660, lr_0 = 9.9425e-04
Validation auc = 0.660737
Epoch 8224
Loss = 3.5826e-02, PNorm = 813.9880, GNorm = 1.9374, lr_0 = 9.9425e-04
Validation auc = 0.662861
Epoch 8225
Loss = 1.0767e-01, PNorm = 814.0162, GNorm = 3.7352, lr_0 = 9.9425e-04
Validation auc = 0.672266
Epoch 8226
Loss = 2.3551e-02, PNorm = 814.0543, GNorm = 0.7782, lr_0 = 9.9425e-04
Validation auc = 0.676771
Epoch 8227
Loss = 1.5262e-02, PNorm = 814.0869, GNorm = 1.0139, lr_0 = 9.9425e-04
Validation auc = 0.676547
Epoch 8228
Loss = 3.5960e-02, PNorm = 814.1248, GNorm = 0.4579, lr_0 = 9.9425e-04
Validation auc = 0.687218
Epoch 8229
Loss = 4.1199e-03, PNorm = 814.1658, GNorm = 0.2771, lr_0 = 9.9424e-04
Loss = 6.4221e-02, PNorm = 814.2176, GNorm = 0.7565, lr_0 = 9.9424e-04
Validation auc = 0.692166
Epoch 8230
Loss = 7.5270e-02, PNorm = 814.2614, GNorm = 1.6456, lr_0 = 9.9424e-04
Validation auc = 0.694966
Epoch 8231
Loss = 3.6264e-02, PNorm = 814.3125, GNorm = 1.5686, lr_0 = 9.9424e-04
Validation auc = 0.700246
Epoch 8232
Loss = 5.2302e-02, PNorm = 814.3549, GNorm = 5.3470, lr_0 = 9.9424e-04
Validation auc = 0.699001
Epoch 8233
Loss = 5.0370e-02, PNorm = 814.3975, GNorm = 1.5782, lr_0 = 9.9424e-04
Validation auc = 0.692809
Epoch 8234
Loss = 2.6263e-02, PNorm = 814.4350, GNorm = 0.4219, lr_0 = 9.9424e-04
Validation auc = 0.688447
Epoch 8235
Loss = 1.0284e-01, PNorm = 814.4661, GNorm = 15.0781, lr_0 = 9.9424e-04
Validation auc = 0.689845
Epoch 8236
Loss = 3.9244e-02, PNorm = 814.5099, GNorm = 5.2233, lr_0 = 9.9424e-04
Validation auc = 0.691919
Epoch 8237
Loss = 9.2985e-02, PNorm = 814.5483, GNorm = 0.3304, lr_0 = 9.9424e-04
Validation auc = 0.688899
Epoch 8238
Loss = 4.9259e-02, PNorm = 814.5803, GNorm = 6.0574, lr_0 = 9.9424e-04
Validation auc = 0.692618
Epoch 8239
Loss = 3.0120e-02, PNorm = 814.6104, GNorm = 1.0659, lr_0 = 9.9424e-04
Loss = 3.5945e-02, PNorm = 814.6392, GNorm = 0.2143, lr_0 = 9.9424e-04
Validation auc = 0.691683
Epoch 8240
Loss = 2.4215e-02, PNorm = 814.6651, GNorm = 3.7636, lr_0 = 9.9424e-04
Validation auc = 0.693025
Epoch 8241
Loss = 3.0521e-02, PNorm = 814.6955, GNorm = 2.8015, lr_0 = 9.9424e-04
Validation auc = 0.695418
Epoch 8242
Loss = 4.0807e-02, PNorm = 814.7263, GNorm = 1.0695, lr_0 = 9.9423e-04
Validation auc = 0.692141
Epoch 8243
Loss = 7.1445e-02, PNorm = 814.7655, GNorm = 1.3004, lr_0 = 9.9423e-04
Validation auc = 0.684464
Epoch 8244
Loss = 6.3664e-02, PNorm = 814.8047, GNorm = 3.7493, lr_0 = 9.9423e-04
Validation auc = 0.676536
Epoch 8245
Loss = 2.3721e-02, PNorm = 814.8394, GNorm = 1.1221, lr_0 = 9.9423e-04
Validation auc = 0.676635
Epoch 8246
Loss = 1.7970e-02, PNorm = 814.8718, GNorm = 0.2356, lr_0 = 9.9423e-04
Validation auc = 0.678534
Epoch 8247
Loss = 4.0193e-02, PNorm = 814.8991, GNorm = 0.7862, lr_0 = 9.9423e-04
Validation auc = 0.684350
Epoch 8248
Loss = 9.4660e-02, PNorm = 814.9700, GNorm = 4.3402, lr_0 = 9.9423e-04
Validation auc = 0.680555
Epoch 8249
Loss = 1.8249e-02, PNorm = 815.0309, GNorm = 0.6815, lr_0 = 9.9423e-04
Loss = 5.5417e-02, PNorm = 815.0698, GNorm = 1.7318, lr_0 = 9.9423e-04
Validation auc = 0.682712
Epoch 8250
Loss = 6.5316e-02, PNorm = 815.1054, GNorm = 1.6643, lr_0 = 9.9423e-04
Validation auc = 0.693434
Epoch 8251
Loss = 6.9777e-02, PNorm = 815.1475, GNorm = 2.5964, lr_0 = 9.9423e-04
Validation auc = 0.698716
Epoch 8252
Loss = 3.2876e-02, PNorm = 815.1921, GNorm = 0.4816, lr_0 = 9.9423e-04
Validation auc = 0.701524
Epoch 8253
Loss = 4.7859e-02, PNorm = 815.2331, GNorm = 1.9480, lr_0 = 9.9423e-04
Validation auc = 0.701973
Epoch 8254
Loss = 2.7813e-02, PNorm = 815.2638, GNorm = 1.4052, lr_0 = 9.9423e-04
Validation auc = 0.705228
Epoch 8255
Loss = 4.3647e-02, PNorm = 815.2904, GNorm = 4.3882, lr_0 = 9.9422e-04
Validation auc = 0.703037
Epoch 8256
Loss = 4.7636e-02, PNorm = 815.3189, GNorm = 0.1958, lr_0 = 9.9422e-04
Validation auc = 0.703452
Epoch 8257
Loss = 1.2586e-02, PNorm = 815.3432, GNorm = 0.1629, lr_0 = 9.9422e-04
Validation auc = 0.702865
Epoch 8258
Loss = 3.4608e-02, PNorm = 815.3684, GNorm = 2.1742, lr_0 = 9.9422e-04
Validation auc = 0.696001
Epoch 8259
Loss = 1.3759e-02, PNorm = 815.3976, GNorm = 0.9103, lr_0 = 9.9422e-04
Loss = 1.8714e-02, PNorm = 815.4222, GNorm = 2.8628, lr_0 = 9.9422e-04
Validation auc = 0.696272
Epoch 8260
Loss = 1.5010e-02, PNorm = 815.4416, GNorm = 2.2673, lr_0 = 9.9422e-04
Validation auc = 0.698445
Epoch 8261
Loss = 2.1296e-02, PNorm = 815.4596, GNorm = 0.6109, lr_0 = 9.9422e-04
Validation auc = 0.699998
Epoch 8262
Loss = 5.1871e-02, PNorm = 815.4826, GNorm = 1.3124, lr_0 = 9.9422e-04
Validation auc = 0.698324
Epoch 8263
Loss = 3.1860e-02, PNorm = 815.5093, GNorm = 1.5363, lr_0 = 9.9422e-04
Validation auc = 0.693424
Epoch 8264
Loss = 8.0751e-02, PNorm = 815.5362, GNorm = 1.2800, lr_0 = 9.9422e-04
Validation auc = 0.693031
Epoch 8265
Loss = 4.8447e-02, PNorm = 815.5756, GNorm = 1.6431, lr_0 = 9.9422e-04
Validation auc = 0.695027
Epoch 8266
Loss = 3.2997e-02, PNorm = 815.6138, GNorm = 0.2468, lr_0 = 9.9422e-04
Validation auc = 0.693608
Epoch 8267
Loss = 3.5490e-02, PNorm = 815.6528, GNorm = 1.5672, lr_0 = 9.9422e-04
Validation auc = 0.693513
Epoch 8268
Loss = 2.6411e-02, PNorm = 815.6986, GNorm = 1.5234, lr_0 = 9.9422e-04
Validation auc = 0.690164
Epoch 8269
Loss = 3.1156e-02, PNorm = 815.7353, GNorm = 1.6415, lr_0 = 9.9421e-04
Loss = 3.5230e-02, PNorm = 815.7674, GNorm = 7.7459, lr_0 = 9.9421e-04
Validation auc = 0.686889
Epoch 8270
Loss = 2.6134e-02, PNorm = 815.8023, GNorm = 1.3213, lr_0 = 9.9421e-04
Validation auc = 0.687697
Epoch 8271
Loss = 6.0737e-02, PNorm = 815.8318, GNorm = 5.2958, lr_0 = 9.9421e-04
Validation auc = 0.690173
Epoch 8272
Loss = 4.7923e-02, PNorm = 815.8663, GNorm = 1.9190, lr_0 = 9.9421e-04
Validation auc = 0.692718
Epoch 8273
Loss = 4.5091e-02, PNorm = 815.8984, GNorm = 4.0126, lr_0 = 9.9421e-04
Validation auc = 0.696448
Epoch 8274
Loss = 2.7801e-02, PNorm = 815.9293, GNorm = 0.4634, lr_0 = 9.9421e-04
Validation auc = 0.700167
Epoch 8275
Loss = 7.6599e-02, PNorm = 815.9559, GNorm = 0.1370, lr_0 = 9.9421e-04
Validation auc = 0.701142
Epoch 8276
Loss = 3.9660e-02, PNorm = 815.9872, GNorm = 5.1024, lr_0 = 9.9421e-04
Validation auc = 0.703120
Epoch 8277
Loss = 8.7318e-02, PNorm = 816.0216, GNorm = 7.4571, lr_0 = 9.9421e-04
Validation auc = 0.700872
Epoch 8278
Loss = 2.2771e-01, PNorm = 816.0695, GNorm = 2.3873, lr_0 = 9.9421e-04
Validation auc = 0.694309
Epoch 8279
Loss = 7.5665e-02, PNorm = 816.1246, GNorm = 3.2776, lr_0 = 9.9421e-04
Loss = 8.1730e-02, PNorm = 816.1817, GNorm = 1.0252, lr_0 = 9.9421e-04
Validation auc = 0.692999
Epoch 8280
Loss = 7.4895e-02, PNorm = 816.2340, GNorm = 1.4821, lr_0 = 9.9421e-04
Validation auc = 0.697628
Epoch 8281
Loss = 3.6252e-02, PNorm = 816.2730, GNorm = 0.7658, lr_0 = 9.9421e-04
Validation auc = 0.698763
Epoch 8282
Loss = 2.3423e-01, PNorm = 816.3154, GNorm = 3.7506, lr_0 = 9.9420e-04
Validation auc = 0.698806
Epoch 8283
Loss = 9.9309e-02, PNorm = 816.3621, GNorm = 3.5030, lr_0 = 9.9420e-04
Validation auc = 0.693675
Epoch 8284
Loss = 4.6167e-02, PNorm = 816.4061, GNorm = 2.2204, lr_0 = 9.9420e-04
Validation auc = 0.695171
Epoch 8285
Loss = 9.5530e-02, PNorm = 816.4444, GNorm = 3.0195, lr_0 = 9.9420e-04
Validation auc = 0.705397
Epoch 8286
Loss = 2.0195e-02, PNorm = 816.4877, GNorm = 4.9620, lr_0 = 9.9420e-04
Validation auc = 0.709958
Epoch 8287
Loss = 3.4893e-02, PNorm = 816.5341, GNorm = 1.2858, lr_0 = 9.9420e-04
Validation auc = 0.711365
Epoch 8288
Loss = 3.9872e-02, PNorm = 816.5728, GNorm = 1.9704, lr_0 = 9.9420e-04
Validation auc = 0.707840
Epoch 8289
Loss = 6.2569e-02, PNorm = 816.6087, GNorm = 4.5290, lr_0 = 9.9420e-04
Loss = 4.8490e-02, PNorm = 816.6473, GNorm = 1.0921, lr_0 = 9.9420e-04
Validation auc = 0.712309
Epoch 8290
Loss = 2.1617e-02, PNorm = 816.6782, GNorm = 1.3090, lr_0 = 9.9420e-04
Validation auc = 0.709801
Epoch 8291
Loss = 4.0506e-02, PNorm = 816.7042, GNorm = 1.0488, lr_0 = 9.9420e-04
Validation auc = 0.711356
Epoch 8292
Loss = 3.8356e-02, PNorm = 816.7372, GNorm = 1.0003, lr_0 = 9.9420e-04
Validation auc = 0.712561
Epoch 8293
Loss = 3.9919e-02, PNorm = 816.7733, GNorm = 5.2510, lr_0 = 9.9420e-04
Validation auc = 0.709102
Epoch 8294
Loss = 3.9848e-02, PNorm = 816.8097, GNorm = 5.2464, lr_0 = 9.9420e-04
Validation auc = 0.703137
Epoch 8295
Loss = 3.0677e-02, PNorm = 816.8466, GNorm = 4.0241, lr_0 = 9.9419e-04
Validation auc = 0.698111
Epoch 8296
Loss = 1.5779e-02, PNorm = 816.8875, GNorm = 7.2354, lr_0 = 9.9419e-04
Validation auc = 0.697921
Epoch 8297
Loss = 7.9572e-03, PNorm = 816.9214, GNorm = 0.3174, lr_0 = 9.9419e-04
Validation auc = 0.694898
Epoch 8298
Loss = 1.8327e-02, PNorm = 816.9477, GNorm = 2.6459, lr_0 = 9.9419e-04
Validation auc = 0.697314
Epoch 8299
Loss = 1.5413e-02, PNorm = 816.9793, GNorm = 1.9095, lr_0 = 9.9419e-04
Loss = 1.5224e-02, PNorm = 817.0081, GNorm = 1.8450, lr_0 = 9.9419e-04
Validation auc = 0.697380
Epoch 8300
Loss = 1.2335e-01, PNorm = 817.0455, GNorm = 0.9136, lr_0 = 9.9419e-04
Validation auc = 0.700193
Epoch 8301
Loss = 4.8868e-02, PNorm = 817.0881, GNorm = 2.2997, lr_0 = 9.9419e-04
Validation auc = 0.701938
Epoch 8302
Loss = 6.8334e-02, PNorm = 817.1278, GNorm = 0.8279, lr_0 = 9.9419e-04
Validation auc = 0.705025
Epoch 8303
Loss = 5.5214e-02, PNorm = 817.1667, GNorm = 2.6783, lr_0 = 9.9419e-04
Validation auc = 0.704516
Epoch 8304
Loss = 6.3346e-02, PNorm = 817.2051, GNorm = 73.3295, lr_0 = 9.9419e-04
Validation auc = 0.703959
Epoch 8305
Loss = 4.8396e-02, PNorm = 817.2775, GNorm = 0.7528, lr_0 = 9.9419e-04
Validation auc = 0.710658
Epoch 8306
Loss = 6.9261e-02, PNorm = 817.3363, GNorm = 3.6882, lr_0 = 9.9419e-04
Validation auc = 0.708017
Epoch 8307
Loss = 6.7115e-02, PNorm = 817.3750, GNorm = 1.0000, lr_0 = 9.9419e-04
Validation auc = 0.699224
Epoch 8308
Loss = 3.2455e-02, PNorm = 817.4251, GNorm = 0.4887, lr_0 = 9.9419e-04
Validation auc = 0.694247
Epoch 8309
Loss = 7.1257e-03, PNorm = 817.4693, GNorm = 0.3047, lr_0 = 9.9418e-04
Loss = 8.8563e-02, PNorm = 817.5046, GNorm = 1.3782, lr_0 = 9.9418e-04
Validation auc = 0.689850
Epoch 8310
Loss = 5.5235e-02, PNorm = 817.5473, GNorm = 1.2087, lr_0 = 9.9418e-04
Validation auc = 0.680271
Epoch 8311
Loss = 5.2019e-02, PNorm = 817.5948, GNorm = 1.8407, lr_0 = 9.9418e-04
Validation auc = 0.684202
Epoch 8312
Loss = 6.2283e-02, PNorm = 817.6389, GNorm = 2.1540, lr_0 = 9.9418e-04
Validation auc = 0.686476
Epoch 8313
Loss = 1.0144e-01, PNorm = 817.6807, GNorm = 1.4292, lr_0 = 9.9418e-04
Validation auc = 0.678422
Epoch 8314
Loss = 3.7858e-02, PNorm = 817.7289, GNorm = 1.0305, lr_0 = 9.9418e-04
Validation auc = 0.675252
Epoch 8315
Loss = 4.2441e-02, PNorm = 817.7679, GNorm = 3.0810, lr_0 = 9.9418e-04
Validation auc = 0.682394
Epoch 8316
Loss = 1.0267e-01, PNorm = 817.8054, GNorm = 1.8636, lr_0 = 9.9418e-04
Validation auc = 0.692418
Epoch 8317
Loss = 1.0042e-01, PNorm = 817.8431, GNorm = 8.9558, lr_0 = 9.9418e-04
Validation auc = 0.696040
Epoch 8318
Loss = 2.3677e-02, PNorm = 817.8840, GNorm = 1.5480, lr_0 = 9.9418e-04
Validation auc = 0.700866
Epoch 8319
Loss = 1.1206e-02, PNorm = 817.9292, GNorm = 0.6395, lr_0 = 9.9418e-04
Loss = 7.1044e-02, PNorm = 817.9728, GNorm = 6.5598, lr_0 = 9.9418e-04
Validation auc = 0.704410
Epoch 8320
Loss = 6.8308e-02, PNorm = 818.0255, GNorm = 2.7955, lr_0 = 9.9418e-04
Validation auc = 0.704169
Epoch 8321
Loss = 4.5569e-02, PNorm = 818.0905, GNorm = 0.6878, lr_0 = 9.9418e-04
Validation auc = 0.710980
Epoch 8322
Loss = 6.0612e-02, PNorm = 818.1396, GNorm = 0.4276, lr_0 = 9.9417e-04
Validation auc = 0.714234
Epoch 8323
Loss = 2.0695e-02, PNorm = 818.1783, GNorm = 0.1790, lr_0 = 9.9417e-04
Validation auc = 0.713005
Epoch 8324
Loss = 2.3016e-01, PNorm = 818.2163, GNorm = 2.9021, lr_0 = 9.9417e-04
Validation auc = 0.717560
Epoch 8325
Loss = 3.3507e-02, PNorm = 818.2781, GNorm = 1.0668, lr_0 = 9.9417e-04
Validation auc = 0.716954
Epoch 8326
Loss = 8.6375e-02, PNorm = 818.3374, GNorm = 0.8209, lr_0 = 9.9417e-04
Validation auc = 0.704248
Epoch 8327
Loss = 4.3039e-02, PNorm = 818.3924, GNorm = 1.5162, lr_0 = 9.9417e-04
Validation auc = 0.699419
Epoch 8328
Loss = 1.3215e-01, PNorm = 818.4323, GNorm = 5.5031, lr_0 = 9.9417e-04
Validation auc = 0.700284
Epoch 8329
Loss = 3.1152e-02, PNorm = 818.4678, GNorm = 1.5808, lr_0 = 9.9417e-04
Loss = 4.3702e-02, PNorm = 818.4997, GNorm = 0.4342, lr_0 = 9.9417e-04
Validation auc = 0.701719
Epoch 8330
Loss = 3.5407e-02, PNorm = 818.5292, GNorm = 0.3615, lr_0 = 9.9417e-04
Validation auc = 0.707285
Epoch 8331
Loss = 4.5293e-02, PNorm = 818.5567, GNorm = 0.5227, lr_0 = 9.9417e-04
Validation auc = 0.709852
Epoch 8332
Loss = 4.6006e-02, PNorm = 818.5881, GNorm = 2.2953, lr_0 = 9.9417e-04
Validation auc = 0.703457
Epoch 8333
Loss = 2.5240e-02, PNorm = 818.6184, GNorm = 6.2497, lr_0 = 9.9417e-04
Validation auc = 0.694941
Epoch 8334
Loss = 4.5310e-02, PNorm = 818.6495, GNorm = 0.5185, lr_0 = 9.9417e-04
Validation auc = 0.695892
Epoch 8335
Loss = 2.4278e-02, PNorm = 818.6773, GNorm = 0.8772, lr_0 = 9.9416e-04
Validation auc = 0.692962
Epoch 8336
Loss = 1.8108e-02, PNorm = 818.7028, GNorm = 4.6804, lr_0 = 9.9416e-04
Validation auc = 0.689642
Epoch 8337
Loss = 2.6852e-02, PNorm = 818.7321, GNorm = 0.6884, lr_0 = 9.9416e-04
Validation auc = 0.688654
Epoch 8338
Loss = 3.8413e-02, PNorm = 818.7626, GNorm = 1.9105, lr_0 = 9.9416e-04
Validation auc = 0.697381
Epoch 8339
Loss = 1.3482e-02, PNorm = 818.8019, GNorm = 0.9683, lr_0 = 9.9416e-04
Loss = 4.7210e-01, PNorm = 818.8798, GNorm = 0.3079, lr_0 = 9.9416e-04
Validation auc = 0.700981
Epoch 8340
Loss = 7.1837e-02, PNorm = 818.9975, GNorm = 3.0143, lr_0 = 9.9416e-04
Validation auc = 0.707406
Epoch 8341
Loss = 8.0391e-02, PNorm = 819.0725, GNorm = 9.5173, lr_0 = 9.9416e-04
Validation auc = 0.701030
Epoch 8342
Loss = 7.9157e-02, PNorm = 819.1355, GNorm = 4.8016, lr_0 = 9.9416e-04
Validation auc = 0.705243
Epoch 8343
Loss = 8.7993e-02, PNorm = 819.1961, GNorm = 1.6973, lr_0 = 9.9416e-04
Validation auc = 0.705272
Epoch 8344
Loss = 1.1772e-01, PNorm = 819.2459, GNorm = 1.1988, lr_0 = 9.9416e-04
Validation auc = 0.695424
Epoch 8345
Loss = 4.1956e-02, PNorm = 819.2844, GNorm = 2.0038, lr_0 = 9.9416e-04
Validation auc = 0.696655
Epoch 8346
Loss = 4.9650e-02, PNorm = 819.3216, GNorm = 3.1172, lr_0 = 9.9416e-04
Validation auc = 0.698273
Epoch 8347
Loss = 9.1911e-02, PNorm = 819.3554, GNorm = 0.2935, lr_0 = 9.9416e-04
Validation auc = 0.701606
Epoch 8348
Loss = 1.0604e-02, PNorm = 819.3949, GNorm = 0.5640, lr_0 = 9.9416e-04
Validation auc = 0.705694
Epoch 8349
Loss = 7.1868e-03, PNorm = 819.4347, GNorm = 0.2445, lr_0 = 9.9415e-04
Loss = 8.1376e-02, PNorm = 819.4697, GNorm = 2.4756, lr_0 = 9.9415e-04
Validation auc = 0.706803
Epoch 8350
Loss = 3.6060e-02, PNorm = 819.5030, GNorm = 0.8458, lr_0 = 9.9415e-04
Validation auc = 0.707963
Epoch 8351
Loss = 4.4304e-02, PNorm = 819.5326, GNorm = 0.7356, lr_0 = 9.9415e-04
Validation auc = 0.707680
Epoch 8352
Loss = 4.0366e-02, PNorm = 819.5602, GNorm = 0.1687, lr_0 = 9.9415e-04
Validation auc = 0.708506
Epoch 8353
Loss = 5.7951e-02, PNorm = 819.5900, GNorm = 4.7769, lr_0 = 9.9415e-04
Validation auc = 0.709018
Epoch 8354
Loss = 4.3208e-02, PNorm = 819.6446, GNorm = 1.8937, lr_0 = 9.9415e-04
Validation auc = 0.713581
Epoch 8355
Loss = 2.2174e-02, PNorm = 819.6959, GNorm = 0.2417, lr_0 = 9.9415e-04
Validation auc = 0.713924
Epoch 8356
Loss = 2.5009e-02, PNorm = 819.7324, GNorm = 0.5338, lr_0 = 9.9415e-04
Validation auc = 0.708180
Epoch 8357
Loss = 3.7679e-02, PNorm = 819.7675, GNorm = 0.4127, lr_0 = 9.9415e-04
Validation auc = 0.699695
Epoch 8358
Loss = 3.8059e-03, PNorm = 819.7981, GNorm = 0.2161, lr_0 = 9.9415e-04
Validation auc = 0.693866
Epoch 8359
Loss = 4.5343e-02, PNorm = 819.8209, GNorm = 3.0455, lr_0 = 9.9415e-04
Loss = 4.9949e-02, PNorm = 819.8480, GNorm = 1.7079, lr_0 = 9.9415e-04
Validation auc = 0.698441
Epoch 8360
Loss = 3.1851e-02, PNorm = 819.8904, GNorm = 3.1688, lr_0 = 9.9415e-04
Validation auc = 0.698089
Epoch 8361
Loss = 4.7350e-02, PNorm = 819.9231, GNorm = 3.6770, lr_0 = 9.9414e-04
Validation auc = 0.698216
Epoch 8362
Loss = 7.7961e-02, PNorm = 819.9554, GNorm = 0.5426, lr_0 = 9.9414e-04
Validation auc = 0.694697
Epoch 8363
Loss = 2.1326e-02, PNorm = 819.9987, GNorm = 0.3192, lr_0 = 9.9414e-04
Validation auc = 0.694009
Epoch 8364
Loss = 1.8454e-02, PNorm = 820.0301, GNorm = 0.4092, lr_0 = 9.9414e-04
Validation auc = 0.693032
Epoch 8365
Loss = 3.5771e-02, PNorm = 820.0552, GNorm = 1.7470, lr_0 = 9.9414e-04
Validation auc = 0.696278
Epoch 8366
Loss = 9.6779e-02, PNorm = 820.0809, GNorm = 0.3858, lr_0 = 9.9414e-04
Validation auc = 0.689717
Epoch 8367
Loss = 6.7862e-02, PNorm = 820.1173, GNorm = 1.7237, lr_0 = 9.9414e-04
Validation auc = 0.680523
Epoch 8368
Loss = 3.7934e-02, PNorm = 820.1647, GNorm = 1.2195, lr_0 = 9.9414e-04
Validation auc = 0.676271
Epoch 8369
Loss = 1.6059e-01, PNorm = 820.2499, GNorm = 9.5358, lr_0 = 9.9414e-04
Loss = 5.9309e-02, PNorm = 820.3276, GNorm = 2.5418, lr_0 = 9.9414e-04
Validation auc = 0.676419
Epoch 8370
Loss = 4.5884e-02, PNorm = 820.3836, GNorm = 1.4872, lr_0 = 9.9414e-04
Validation auc = 0.683397
Epoch 8371
Loss = 7.6423e-02, PNorm = 820.4242, GNorm = 4.9706, lr_0 = 9.9414e-04
Validation auc = 0.686653
Epoch 8372
Loss = 6.5252e-02, PNorm = 820.4634, GNorm = 1.0133, lr_0 = 9.9414e-04
Validation auc = 0.684161
Epoch 8373
Loss = 4.2332e-02, PNorm = 820.5098, GNorm = 1.1611, lr_0 = 9.9414e-04
Validation auc = 0.684325
Epoch 8374
Loss = 6.2230e-02, PNorm = 820.5478, GNorm = 0.6108, lr_0 = 9.9414e-04
Validation auc = 0.682363
Epoch 8375
Loss = 4.3750e-02, PNorm = 820.5817, GNorm = 0.5053, lr_0 = 9.9413e-04
Validation auc = 0.681191
Epoch 8376
Loss = 1.1480e-02, PNorm = 820.6130, GNorm = 1.4057, lr_0 = 9.9413e-04
Validation auc = 0.679992
Epoch 8377
Loss = 3.1215e-01, PNorm = 820.6388, GNorm = 1.6863, lr_0 = 9.9413e-04
Validation auc = 0.684572
Epoch 8378
Loss = 3.0730e-02, PNorm = 820.6786, GNorm = 5.0813, lr_0 = 9.9413e-04
Validation auc = 0.686262
Epoch 8379
Loss = 3.0968e-02, PNorm = 820.7258, GNorm = 1.3327, lr_0 = 9.9413e-04
Loss = 5.1497e-02, PNorm = 820.7653, GNorm = 2.2141, lr_0 = 9.9413e-04
Validation auc = 0.688376
Epoch 8380
Loss = 1.0503e-01, PNorm = 820.8098, GNorm = 1.4138, lr_0 = 9.9413e-04
Validation auc = 0.694426
Epoch 8381
Loss = 5.6750e-02, PNorm = 820.8525, GNorm = 1.7033, lr_0 = 9.9413e-04
Validation auc = 0.699834
Epoch 8382
Loss = 1.1343e-01, PNorm = 820.9129, GNorm = 14.1080, lr_0 = 9.9413e-04
Validation auc = 0.698430
Epoch 8383
Loss = 4.4583e-02, PNorm = 820.9879, GNorm = 2.3091, lr_0 = 9.9413e-04
Validation auc = 0.695200
Epoch 8384
Loss = 1.3377e-01, PNorm = 821.0456, GNorm = 2.1812, lr_0 = 9.9413e-04
Validation auc = 0.693701
Epoch 8385
Loss = 6.1850e-02, PNorm = 821.0978, GNorm = 0.8009, lr_0 = 9.9413e-04
Validation auc = 0.692010
Epoch 8386
Loss = 1.5510e-01, PNorm = 821.1382, GNorm = 1.0394, lr_0 = 9.9413e-04
Validation auc = 0.688485
Epoch 8387
Loss = 5.4398e-02, PNorm = 821.1831, GNorm = 0.6099, lr_0 = 9.9413e-04
Validation auc = 0.690471
Epoch 8388
Loss = 5.4974e-02, PNorm = 821.2181, GNorm = 1.7259, lr_0 = 9.9413e-04
Validation auc = 0.684751
Epoch 8389
Loss = 5.4053e-02, PNorm = 821.2522, GNorm = 2.9797, lr_0 = 9.9412e-04
Loss = 5.9061e-02, PNorm = 821.2845, GNorm = 2.0600, lr_0 = 9.9412e-04
Validation auc = 0.684626
Epoch 8390
Loss = 5.1387e-02, PNorm = 821.3209, GNorm = 2.7822, lr_0 = 9.9412e-04
Validation auc = 0.689036
Epoch 8391
Loss = 5.0555e-02, PNorm = 821.3528, GNorm = 1.2306, lr_0 = 9.9412e-04
Validation auc = 0.690127
Epoch 8392
Loss = 6.9475e-02, PNorm = 821.3903, GNorm = 5.4307, lr_0 = 9.9412e-04
Validation auc = 0.687438
Epoch 8393
Loss = 3.1579e-02, PNorm = 821.4259, GNorm = 6.6786, lr_0 = 9.9412e-04
Validation auc = 0.693761
Epoch 8394
Loss = 7.9002e-02, PNorm = 821.4684, GNorm = 4.8786, lr_0 = 9.9412e-04
Validation auc = 0.695503
Epoch 8395
Loss = 8.4188e-02, PNorm = 821.5199, GNorm = 1.9541, lr_0 = 9.9412e-04
Validation auc = 0.692923
Epoch 8396
Loss = 4.0040e-02, PNorm = 821.5881, GNorm = 1.6858, lr_0 = 9.9412e-04
Validation auc = 0.692349
Epoch 8397
Loss = 2.2281e-02, PNorm = 821.6439, GNorm = 1.0906, lr_0 = 9.9412e-04
Validation auc = 0.690794
Epoch 8398
Loss = 2.9259e-02, PNorm = 821.6846, GNorm = 1.9101, lr_0 = 9.9412e-04
Validation auc = 0.691412
Epoch 8399
Loss = 7.1762e-03, PNorm = 821.7154, GNorm = 0.4697, lr_0 = 9.9412e-04
Loss = 3.6136e-02, PNorm = 821.7383, GNorm = 0.6760, lr_0 = 9.9412e-04
Validation auc = 0.693411
Epoch 8400
Loss = 3.7085e-02, PNorm = 821.7589, GNorm = 1.4753, lr_0 = 9.9412e-04
Validation auc = 0.693162
Epoch 8401
Loss = 2.6384e-02, PNorm = 821.7815, GNorm = 1.0223, lr_0 = 9.9411e-04
Validation auc = 0.695356
Epoch 8402
Loss = 3.7189e-02, PNorm = 821.8067, GNorm = 0.1843, lr_0 = 9.9411e-04
Validation auc = 0.694380
Epoch 8403
Loss = 1.6334e-02, PNorm = 821.8312, GNorm = 0.3201, lr_0 = 9.9411e-04
Validation auc = 0.692489
Epoch 8404
Loss = 1.8191e-02, PNorm = 821.8553, GNorm = 0.7048, lr_0 = 9.9411e-04
Validation auc = 0.691582
Epoch 8405
Loss = 2.0582e-02, PNorm = 821.8763, GNorm = 0.8129, lr_0 = 9.9411e-04
Validation auc = 0.693748
Epoch 8406
Loss = 2.6546e-02, PNorm = 821.9029, GNorm = 3.5719, lr_0 = 9.9411e-04
Validation auc = 0.694479
Epoch 8407
Loss = 1.1878e-02, PNorm = 821.9294, GNorm = 0.5543, lr_0 = 9.9411e-04
Validation auc = 0.695989
Epoch 8408
Loss = 1.2766e-02, PNorm = 821.9489, GNorm = 0.8450, lr_0 = 9.9411e-04
Validation auc = 0.696603
Epoch 8409
Loss = 6.6080e-03, PNorm = 821.9732, GNorm = 0.7973, lr_0 = 9.9411e-04
Loss = 3.7752e-02, PNorm = 821.9984, GNorm = 0.9941, lr_0 = 9.9411e-04
Validation auc = 0.695679
Epoch 8410
Loss = 1.9830e-02, PNorm = 822.0232, GNorm = 0.6833, lr_0 = 9.9411e-04
Validation auc = 0.693614
Epoch 8411
Loss = 7.1656e-02, PNorm = 822.0522, GNorm = 2.6693, lr_0 = 9.9411e-04
Validation auc = 0.693197
Epoch 8412
Loss = 2.6518e-02, PNorm = 822.0868, GNorm = 2.9340, lr_0 = 9.9411e-04
Validation auc = 0.692974
Epoch 8413
Loss = 3.1663e-02, PNorm = 822.1201, GNorm = 0.2685, lr_0 = 9.9411e-04
Validation auc = 0.689451
Epoch 8414
Loss = 4.2220e-02, PNorm = 822.1494, GNorm = 4.1613, lr_0 = 9.9411e-04
Validation auc = 0.688004
Epoch 8415
Loss = 5.1469e-02, PNorm = 822.1807, GNorm = 0.6908, lr_0 = 9.9410e-04
Validation auc = 0.687265
Epoch 8416
Loss = 6.8662e-02, PNorm = 822.2153, GNorm = 0.2287, lr_0 = 9.9410e-04
Validation auc = 0.689553
Epoch 8417
Loss = 2.1881e-02, PNorm = 822.2492, GNorm = 2.0240, lr_0 = 9.9410e-04
Validation auc = 0.694287
Epoch 8418
Loss = 3.0045e-02, PNorm = 822.2876, GNorm = 0.4857, lr_0 = 9.9410e-04
Validation auc = 0.693502
Epoch 8419
Loss = 5.0669e-03, PNorm = 822.3249, GNorm = 0.3185, lr_0 = 9.9410e-04
Loss = 6.3133e-02, PNorm = 822.3546, GNorm = 0.4506, lr_0 = 9.9410e-04
Validation auc = 0.693442
Epoch 8420
Loss = 8.8238e-02, PNorm = 822.3926, GNorm = 0.9600, lr_0 = 9.9410e-04
Validation auc = 0.689943
Epoch 8421
Loss = 5.7761e-02, PNorm = 822.4430, GNorm = 1.3792, lr_0 = 9.9410e-04
Validation auc = 0.696536
Epoch 8422
Loss = 3.4724e-02, PNorm = 822.4863, GNorm = 1.8738, lr_0 = 9.9410e-04
Validation auc = 0.694081
Epoch 8423
Loss = 5.7781e-02, PNorm = 822.5224, GNorm = 3.6928, lr_0 = 9.9410e-04
Validation auc = 0.692967
Epoch 8424
Loss = 2.8269e-02, PNorm = 822.5501, GNorm = 2.0959, lr_0 = 9.9410e-04
Validation auc = 0.689347
Epoch 8425
Loss = 4.5891e-02, PNorm = 822.5751, GNorm = 1.2664, lr_0 = 9.9410e-04
Validation auc = 0.682659
Epoch 8426
Loss = 6.8327e-02, PNorm = 822.6067, GNorm = 2.2419, lr_0 = 9.9410e-04
Validation auc = 0.676357
Epoch 8427
Loss = 3.0494e-02, PNorm = 822.6457, GNorm = 2.3052, lr_0 = 9.9410e-04
Validation auc = 0.672736
Epoch 8428
Loss = 4.5342e-02, PNorm = 822.6827, GNorm = 0.7248, lr_0 = 9.9409e-04
Validation auc = 0.675168
Epoch 8429
Loss = 3.8030e-02, PNorm = 822.7197, GNorm = 1.4676, lr_0 = 9.9409e-04
Loss = 4.5989e-02, PNorm = 822.7574, GNorm = 1.8602, lr_0 = 9.9409e-04
Validation auc = 0.676522
Epoch 8430
Loss = 1.5631e-02, PNorm = 822.7912, GNorm = 0.4884, lr_0 = 9.9409e-04
Validation auc = 0.676370
Epoch 8431
Loss = 2.8014e-02, PNorm = 822.8140, GNorm = 2.5437, lr_0 = 9.9409e-04
Validation auc = 0.675581
Epoch 8432
Loss = 2.7214e-02, PNorm = 822.8356, GNorm = 2.5570, lr_0 = 9.9409e-04
Validation auc = 0.678279
Epoch 8433
Loss = 4.2785e-02, PNorm = 822.8563, GNorm = 0.5718, lr_0 = 9.9409e-04
Validation auc = 0.678344
Epoch 8434
Loss = 4.3687e-02, PNorm = 822.8788, GNorm = 3.8088, lr_0 = 9.9409e-04
Validation auc = 0.675440
Epoch 8435
Loss = 4.5185e-02, PNorm = 822.9030, GNorm = 0.3080, lr_0 = 9.9409e-04
Validation auc = 0.675989
Epoch 8436
Loss = 4.2497e-02, PNorm = 822.9260, GNorm = 3.5474, lr_0 = 9.9409e-04
Validation auc = 0.678253
Epoch 8437
Loss = 2.0759e-02, PNorm = 822.9486, GNorm = 2.0472, lr_0 = 9.9409e-04
Validation auc = 0.676623
Epoch 8438
Loss = 2.0125e-02, PNorm = 822.9744, GNorm = 1.4157, lr_0 = 9.9409e-04
Validation auc = 0.676215
Epoch 8439
Loss = 1.7097e-02, PNorm = 823.0006, GNorm = 1.5192, lr_0 = 9.9409e-04
Loss = 3.8579e-02, PNorm = 823.0294, GNorm = 1.0662, lr_0 = 9.9409e-04
Validation auc = 0.675839
Epoch 8440
Loss = 3.8294e-02, PNorm = 823.0552, GNorm = 0.5753, lr_0 = 9.9409e-04
Validation auc = 0.680074
Epoch 8441
Loss = 3.1184e-02, PNorm = 823.0792, GNorm = 0.5886, lr_0 = 9.9408e-04
Validation auc = 0.679943
Epoch 8442
Loss = 6.2170e-02, PNorm = 823.1024, GNorm = 0.5402, lr_0 = 9.9408e-04
Validation auc = 0.677385
Epoch 8443
Loss = 3.6491e-02, PNorm = 823.1281, GNorm = 0.4328, lr_0 = 9.9408e-04
Validation auc = 0.674100
Epoch 8444
Loss = 3.3402e-02, PNorm = 823.1578, GNorm = 0.6546, lr_0 = 9.9408e-04
Validation auc = 0.674806
Epoch 8445
Loss = 2.8481e-02, PNorm = 823.1905, GNorm = 0.6208, lr_0 = 9.9408e-04
Validation auc = 0.679656
Epoch 8446
Loss = 2.4057e-02, PNorm = 823.2198, GNorm = 0.3493, lr_0 = 9.9408e-04
Validation auc = 0.680867
Epoch 8447
Loss = 2.0585e-02, PNorm = 823.2427, GNorm = 1.9175, lr_0 = 9.9408e-04
Validation auc = 0.679369
Epoch 8448
Loss = 4.3140e-03, PNorm = 823.2643, GNorm = 0.2573, lr_0 = 9.9408e-04
Validation auc = 0.678787
Epoch 8449
Loss = 4.1594e-03, PNorm = 823.2824, GNorm = 0.2623, lr_0 = 9.9408e-04
Loss = 3.1628e-02, PNorm = 823.3065, GNorm = 0.5077, lr_0 = 9.9408e-04
Validation auc = 0.678380
Epoch 8450
Loss = 5.9447e-02, PNorm = 823.3330, GNorm = 0.8186, lr_0 = 9.9408e-04
Validation auc = 0.680032
Epoch 8451
Loss = 6.5118e-02, PNorm = 823.3694, GNorm = 0.4755, lr_0 = 9.9408e-04
Validation auc = 0.682607
Epoch 8452
Loss = 4.5630e-02, PNorm = 823.4273, GNorm = 0.4338, lr_0 = 9.9408e-04
Validation auc = 0.683355
Epoch 8453
Loss = 8.4632e-02, PNorm = 823.4817, GNorm = 0.2971, lr_0 = 9.9408e-04
Validation auc = 0.691996
Epoch 8454
Loss = 9.2711e-02, PNorm = 823.5336, GNorm = 1.9419, lr_0 = 9.9408e-04
Validation auc = 0.695579
Epoch 8455
Loss = 5.5124e-02, PNorm = 823.5888, GNorm = 2.0089, lr_0 = 9.9407e-04
Validation auc = 0.687184
Epoch 8456
Loss = 4.5487e-02, PNorm = 823.6527, GNorm = 1.2558, lr_0 = 9.9407e-04
Validation auc = 0.681946
Epoch 8457
Loss = 3.4731e-02, PNorm = 823.7119, GNorm = 0.2950, lr_0 = 9.9407e-04
Validation auc = 0.683926
Epoch 8458
Loss = 7.3184e-02, PNorm = 823.7578, GNorm = 1.5531, lr_0 = 9.9407e-04
Validation auc = 0.682938
Epoch 8459
Loss = 1.1966e-01, PNorm = 823.7994, GNorm = 4.6179, lr_0 = 9.9407e-04
Loss = 3.6572e-02, PNorm = 823.8393, GNorm = 2.7623, lr_0 = 9.9407e-04
Validation auc = 0.686029
Epoch 8460
Loss = 4.7982e-02, PNorm = 823.8699, GNorm = 12.6618, lr_0 = 9.9407e-04
Validation auc = 0.686362
Epoch 8461
Loss = 5.4502e-02, PNorm = 823.9062, GNorm = 5.7038, lr_0 = 9.9407e-04
Validation auc = 0.685773
Epoch 8462
Loss = 4.7958e-02, PNorm = 823.9438, GNorm = 1.6447, lr_0 = 9.9407e-04
Validation auc = 0.684369
Epoch 8463
Loss = 9.4945e-02, PNorm = 823.9760, GNorm = 0.1802, lr_0 = 9.9407e-04
Validation auc = 0.677081
Epoch 8464
Loss = 7.3570e-02, PNorm = 824.0279, GNorm = 3.9352, lr_0 = 9.9407e-04
Validation auc = 0.675278
Epoch 8465
Loss = 4.0791e-02, PNorm = 824.0789, GNorm = 2.4492, lr_0 = 9.9407e-04
Validation auc = 0.675681
Epoch 8466
Loss = 2.9376e-02, PNorm = 824.1171, GNorm = 3.1401, lr_0 = 9.9407e-04
Validation auc = 0.674555
Epoch 8467
Loss = 1.2114e-02, PNorm = 824.1545, GNorm = 0.7384, lr_0 = 9.9407e-04
Validation auc = 0.676323
Epoch 8468
Loss = 4.1064e-02, PNorm = 824.2416, GNorm = 0.9960, lr_0 = 9.9406e-04
Validation auc = 0.678113
Epoch 8469
Loss = 8.7255e-02, PNorm = 824.3166, GNorm = 3.6080, lr_0 = 9.9406e-04
Loss = 5.8204e-02, PNorm = 824.3651, GNorm = 3.9479, lr_0 = 9.9406e-04
Validation auc = 0.682994
Epoch 8470
Loss = 5.7992e-02, PNorm = 824.4067, GNorm = 1.5632, lr_0 = 9.9406e-04
Validation auc = 0.690172
Epoch 8471
Loss = 5.2284e-02, PNorm = 824.4482, GNorm = 2.4473, lr_0 = 9.9406e-04
Validation auc = 0.684238
Epoch 8472
Loss = 3.6859e-02, PNorm = 824.4798, GNorm = 1.6899, lr_0 = 9.9406e-04
Validation auc = 0.683362
Epoch 8473
Loss = 6.4275e-02, PNorm = 824.5154, GNorm = 1.5383, lr_0 = 9.9406e-04
Validation auc = 0.691030
Epoch 8474
Loss = 1.0352e-01, PNorm = 824.5537, GNorm = 6.7179, lr_0 = 9.9406e-04
Validation auc = 0.696488
Epoch 8475
Loss = 4.5210e-02, PNorm = 824.5998, GNorm = 1.9580, lr_0 = 9.9406e-04
Validation auc = 0.693020
Epoch 8476
Loss = 3.4065e-02, PNorm = 824.6391, GNorm = 0.5408, lr_0 = 9.9406e-04
Validation auc = 0.696086
Epoch 8477
Loss = 5.7837e-02, PNorm = 824.6695, GNorm = 0.6736, lr_0 = 9.9406e-04
Validation auc = 0.701003
Epoch 8478
Loss = 4.0044e-02, PNorm = 824.6963, GNorm = 3.3978, lr_0 = 9.9406e-04
Validation auc = 0.699443
Epoch 8479
Loss = 1.1094e-03, PNorm = 824.7217, GNorm = 0.0894, lr_0 = 9.9406e-04
Loss = 1.8065e-02, PNorm = 824.7475, GNorm = 0.7028, lr_0 = 9.9406e-04
Validation auc = 0.694451
Epoch 8480
Loss = 2.9949e-02, PNorm = 824.7705, GNorm = 3.3876, lr_0 = 9.9406e-04
Validation auc = 0.692967
Epoch 8481
Loss = 4.1340e-02, PNorm = 824.7909, GNorm = 2.7685, lr_0 = 9.9405e-04
Validation auc = 0.693956
Epoch 8482
Loss = 4.2750e-02, PNorm = 824.8137, GNorm = 0.9086, lr_0 = 9.9405e-04
Validation auc = 0.694508
Epoch 8483
Loss = 2.6062e-02, PNorm = 824.8353, GNorm = 2.7902, lr_0 = 9.9405e-04
Validation auc = 0.693073
Epoch 8484
Loss = 9.3845e-02, PNorm = 824.8602, GNorm = 1.4459, lr_0 = 9.9405e-04
Validation auc = 0.692499
Epoch 8485
Loss = 4.0956e-02, PNorm = 824.8927, GNorm = 1.2084, lr_0 = 9.9405e-04
Validation auc = 0.689836
Epoch 8486
Loss = 5.3256e-02, PNorm = 824.9258, GNorm = 4.5741, lr_0 = 9.9405e-04
Validation auc = 0.686877
Epoch 8487
Loss = 4.8194e-02, PNorm = 824.9739, GNorm = 0.4506, lr_0 = 9.9405e-04
Validation auc = 0.688369
Epoch 8488
Loss = 4.7491e-03, PNorm = 825.0155, GNorm = 0.2216, lr_0 = 9.9405e-04
Validation auc = 0.690592
Epoch 8489
Loss = 3.0008e-03, PNorm = 825.0518, GNorm = 0.2039, lr_0 = 9.9405e-04
Loss = 5.1966e-02, PNorm = 825.0817, GNorm = 1.6886, lr_0 = 9.9405e-04
Validation auc = 0.691912
Epoch 8490
Loss = 3.2520e-02, PNorm = 825.1091, GNorm = 2.1551, lr_0 = 9.9405e-04
Validation auc = 0.697890
Epoch 8491
Loss = 5.7279e-02, PNorm = 825.1432, GNorm = 0.6366, lr_0 = 9.9405e-04
Validation auc = 0.692310
Epoch 8492
Loss = 6.1316e-02, PNorm = 825.1861, GNorm = 7.2531, lr_0 = 9.9405e-04
Validation auc = 0.691564
Epoch 8493
Loss = 3.1822e-02, PNorm = 825.2318, GNorm = 0.9639, lr_0 = 9.9405e-04
Validation auc = 0.693423
Epoch 8494
Loss = 1.7873e-02, PNorm = 825.2641, GNorm = 0.2709, lr_0 = 9.9404e-04
Validation auc = 0.692391
Epoch 8495
Loss = 2.9146e-02, PNorm = 825.2862, GNorm = 0.8052, lr_0 = 9.9404e-04
Validation auc = 0.683823
Epoch 8496
Loss = 3.7738e-02, PNorm = 825.3066, GNorm = 0.2346, lr_0 = 9.9404e-04
Validation auc = 0.682960
Epoch 8497
Loss = 8.0250e-02, PNorm = 825.3265, GNorm = 0.7977, lr_0 = 9.9404e-04
Validation auc = 0.682336
Epoch 8498
Loss = 9.4624e-03, PNorm = 825.3467, GNorm = 0.1531, lr_0 = 9.9404e-04
Validation auc = 0.683990
Epoch 8499
Loss = 3.7696e-02, PNorm = 825.3658, GNorm = 2.4133, lr_0 = 9.9404e-04
Loss = 3.6504e-02, PNorm = 825.3890, GNorm = 1.2634, lr_0 = 9.9404e-04
Validation auc = 0.682775
Epoch 8500
Loss = 4.8913e-02, PNorm = 825.4131, GNorm = 4.4024, lr_0 = 9.9404e-04
Validation auc = 0.683325
Epoch 8501
Loss = 2.5700e-02, PNorm = 825.4384, GNorm = 0.6925, lr_0 = 9.9404e-04
Validation auc = 0.682190
Epoch 8502
Loss = 2.8704e-02, PNorm = 825.4608, GNorm = 0.6088, lr_0 = 9.9404e-04
Validation auc = 0.687061
Epoch 8503
Loss = 3.1736e-02, PNorm = 825.4912, GNorm = 1.8517, lr_0 = 9.9404e-04
Validation auc = 0.691534
Epoch 8504
Loss = 2.2536e-02, PNorm = 825.5198, GNorm = 0.9046, lr_0 = 9.9404e-04
Validation auc = 0.696596
Epoch 8505
Loss = 1.3832e-02, PNorm = 825.5458, GNorm = 0.8262, lr_0 = 9.9404e-04
Validation auc = 0.696535
Epoch 8506
Loss = 2.6055e-02, PNorm = 825.5652, GNorm = 1.1925, lr_0 = 9.9404e-04
Validation auc = 0.693876
Epoch 8507
Loss = 1.9940e-03, PNorm = 825.5859, GNorm = 0.2573, lr_0 = 9.9404e-04
Validation auc = 0.691277
Epoch 8508
Loss = 8.8195e-03, PNorm = 825.6085, GNorm = 0.4661, lr_0 = 9.9403e-04
Validation auc = 0.687509
Epoch 8509
Loss = 2.3265e-02, PNorm = 825.6350, GNorm = 1.6464, lr_0 = 9.9403e-04
Loss = 3.1627e-02, PNorm = 825.6605, GNorm = 1.5020, lr_0 = 9.9403e-04
Validation auc = 0.683659
Epoch 8510
Loss = 2.8253e-02, PNorm = 825.6824, GNorm = 7.9839, lr_0 = 9.9403e-04
Validation auc = 0.685116
Epoch 8511
Loss = 7.2184e-02, PNorm = 825.7070, GNorm = 0.3958, lr_0 = 9.9403e-04
Validation auc = 0.685706
Epoch 8512
Loss = 4.4123e-02, PNorm = 825.7371, GNorm = 1.7473, lr_0 = 9.9403e-04
Validation auc = 0.688794
Epoch 8513
Loss = 2.9278e-02, PNorm = 825.7629, GNorm = 1.8604, lr_0 = 9.9403e-04
Validation auc = 0.693000
Epoch 8514
Loss = 3.3784e-02, PNorm = 825.7899, GNorm = 4.1795, lr_0 = 9.9403e-04
Validation auc = 0.697510
Epoch 8515
Loss = 7.8759e-02, PNorm = 825.8179, GNorm = 0.3755, lr_0 = 9.9403e-04
Validation auc = 0.699091
Epoch 8516
Loss = 1.5158e-02, PNorm = 825.8458, GNorm = 1.5447, lr_0 = 9.9403e-04
Validation auc = 0.698417
Epoch 8517
Loss = 7.6693e-02, PNorm = 825.8716, GNorm = 4.7330, lr_0 = 9.9403e-04
Validation auc = 0.698028
Epoch 8518
Loss = 2.3874e-03, PNorm = 825.8977, GNorm = 0.1528, lr_0 = 9.9403e-04
Validation auc = 0.698914
Epoch 8519
Loss = 4.4561e-02, PNorm = 825.9197, GNorm = 0.9188, lr_0 = 9.9403e-04
Loss = 1.3391e-02, PNorm = 825.9464, GNorm = 0.3196, lr_0 = 9.9403e-04
Validation auc = 0.700069
Epoch 8520
Loss = 5.7952e-02, PNorm = 825.9685, GNorm = 2.3418, lr_0 = 9.9403e-04
Validation auc = 0.698340
Epoch 8521
Loss = 3.8725e-02, PNorm = 825.9925, GNorm = 0.5136, lr_0 = 9.9402e-04
Validation auc = 0.693124
Epoch 8522
Loss = 2.0616e-02, PNorm = 826.0175, GNorm = 0.6539, lr_0 = 9.9402e-04
Validation auc = 0.690300
Epoch 8523
Loss = 6.2111e-02, PNorm = 826.0387, GNorm = 0.2174, lr_0 = 9.9402e-04
Validation auc = 0.686150
Epoch 8524
Loss = 1.1611e-01, PNorm = 826.0652, GNorm = 1.0805, lr_0 = 9.9402e-04
Validation auc = 0.682635
Epoch 8525
Loss = 2.2594e-02, PNorm = 826.0926, GNorm = 1.3228, lr_0 = 9.9402e-04
Validation auc = 0.680992
Epoch 8526
Loss = 1.0679e-02, PNorm = 826.1168, GNorm = 0.1850, lr_0 = 9.9402e-04
Validation auc = 0.680967
Epoch 8527
Loss = 1.0792e-02, PNorm = 826.1373, GNorm = 1.8490, lr_0 = 9.9402e-04
Validation auc = 0.678978
Epoch 8528
Loss = 1.6308e-02, PNorm = 826.1535, GNorm = 2.2944, lr_0 = 9.9402e-04
Validation auc = 0.676407
Epoch 8529
Loss = 5.6120e-03, PNorm = 826.1719, GNorm = 0.1299, lr_0 = 9.9402e-04
Loss = 6.7811e-02, PNorm = 826.1934, GNorm = 0.3339, lr_0 = 9.9402e-04
Validation auc = 0.679291
Epoch 8530
Loss = 5.0102e-02, PNorm = 826.2255, GNorm = 1.2664, lr_0 = 9.9402e-04
Validation auc = 0.680375
Epoch 8531
Loss = 4.2937e-02, PNorm = 826.2565, GNorm = 0.8253, lr_0 = 9.9402e-04
Validation auc = 0.681180
Epoch 8532
Loss = 4.6802e-02, PNorm = 826.2814, GNorm = 6.9704, lr_0 = 9.9402e-04
Validation auc = 0.682377
Epoch 8533
Loss = 4.8716e-02, PNorm = 826.3100, GNorm = 4.1978, lr_0 = 9.9402e-04
Validation auc = 0.682198
Epoch 8534
Loss = 9.1825e-02, PNorm = 826.3335, GNorm = 3.9536, lr_0 = 9.9401e-04
Validation auc = 0.684039
Epoch 8535
Loss = 3.5510e-02, PNorm = 826.3585, GNorm = 5.6218, lr_0 = 9.9401e-04
Validation auc = 0.691409
Epoch 8536
Loss = 3.1433e-02, PNorm = 826.3906, GNorm = 1.5387, lr_0 = 9.9401e-04
Validation auc = 0.697622
Epoch 8537
Loss = 5.1561e-02, PNorm = 826.4299, GNorm = 0.8426, lr_0 = 9.9401e-04
Validation auc = 0.700427
Epoch 8538
Loss = 2.2994e-02, PNorm = 826.4636, GNorm = 1.7020, lr_0 = 9.9401e-04
Validation auc = 0.697634
Epoch 8539
Loss = 9.5181e-03, PNorm = 826.4911, GNorm = 0.6376, lr_0 = 9.9401e-04
Loss = 2.2573e-02, PNorm = 826.5167, GNorm = 1.3420, lr_0 = 9.9401e-04
Validation auc = 0.699773
Epoch 8540
Loss = 1.9797e-02, PNorm = 826.5440, GNorm = 0.1201, lr_0 = 9.9401e-04
Validation auc = 0.704320
Epoch 8541
Loss = 2.6857e-02, PNorm = 826.5663, GNorm = 1.2057, lr_0 = 9.9401e-04
Validation auc = 0.708377
Epoch 8542
Loss = 2.2328e-02, PNorm = 826.5843, GNorm = 3.2722, lr_0 = 9.9401e-04
Validation auc = 0.705433
Epoch 8543
Loss = 3.0462e-02, PNorm = 826.6072, GNorm = 1.5032, lr_0 = 9.9401e-04
Validation auc = 0.700880
Epoch 8544
Loss = 1.1652e-02, PNorm = 826.6268, GNorm = 0.5046, lr_0 = 9.9401e-04
Validation auc = 0.697163
Epoch 8545
Loss = 5.3130e-02, PNorm = 826.6463, GNorm = 4.2813, lr_0 = 9.9401e-04
Validation auc = 0.690631
Epoch 8546
Loss = 1.1061e-02, PNorm = 826.6777, GNorm = 0.3986, lr_0 = 9.9401e-04
Validation auc = 0.693141
Epoch 8547
Loss = 1.4359e-02, PNorm = 826.7079, GNorm = 0.6618, lr_0 = 9.9401e-04
Validation auc = 0.704138
Epoch 8548
Loss = 1.2380e-01, PNorm = 826.7406, GNorm = 8.4686, lr_0 = 9.9400e-04
Validation auc = 0.710015
Epoch 8549
Loss = 1.4056e-02, PNorm = 826.7836, GNorm = 0.7090, lr_0 = 9.9400e-04
Loss = 4.1817e-02, PNorm = 826.8202, GNorm = 3.2957, lr_0 = 9.9400e-04
Validation auc = 0.707455
Epoch 8550
Loss = 6.2652e-02, PNorm = 826.8501, GNorm = 0.4244, lr_0 = 9.9400e-04
Validation auc = 0.702637
Epoch 8551
Loss = 4.7731e-02, PNorm = 826.8800, GNorm = 2.6088, lr_0 = 9.9400e-04
Validation auc = 0.698708
Epoch 8552
Loss = 4.4422e-02, PNorm = 826.9063, GNorm = 0.2497, lr_0 = 9.9400e-04
Validation auc = 0.697201
Epoch 8553
Loss = 1.5026e-02, PNorm = 826.9321, GNorm = 1.7801, lr_0 = 9.9400e-04
Validation auc = 0.695321
Epoch 8554
Loss = 1.4502e+00, PNorm = 827.0075, GNorm = 1.9505, lr_0 = 9.9400e-04
Validation auc = 0.702115
Epoch 8555
Loss = 8.5991e-02, PNorm = 827.1076, GNorm = 3.0217, lr_0 = 9.9400e-04
Validation auc = 0.695948
Epoch 8556
Loss = 4.8013e-02, PNorm = 827.2020, GNorm = 1.5402, lr_0 = 9.9400e-04
Validation auc = 0.690163
Epoch 8557
Loss = 5.2799e-02, PNorm = 827.2832, GNorm = 1.0621, lr_0 = 9.9400e-04
Validation auc = 0.682454
Epoch 8558
Loss = 4.8180e-02, PNorm = 827.3403, GNorm = 0.8614, lr_0 = 9.9400e-04
Validation auc = 0.689410
Epoch 8559
Loss = 6.9403e-02, PNorm = 827.3847, GNorm = 1.3492, lr_0 = 9.9400e-04
Loss = 1.3991e-01, PNorm = 827.4305, GNorm = 1.8943, lr_0 = 9.9400e-04
Validation auc = 0.698684
Epoch 8560
Loss = 3.4811e-02, PNorm = 827.4770, GNorm = 0.8585, lr_0 = 9.9400e-04
Validation auc = 0.699984
Epoch 8561
Loss = 5.5649e-02, PNorm = 827.5145, GNorm = 1.6917, lr_0 = 9.9399e-04
Validation auc = 0.699096
Epoch 8562
Loss = 3.9148e-02, PNorm = 827.5564, GNorm = 1.3311, lr_0 = 9.9399e-04
Validation auc = 0.702366
Epoch 8563
Loss = 4.3048e-02, PNorm = 827.5997, GNorm = 2.7717, lr_0 = 9.9399e-04
Validation auc = 0.699865
Epoch 8564
Loss = 4.8569e-01, PNorm = 827.6472, GNorm = 158.0572, lr_0 = 9.9399e-04
Validation auc = 0.693198
Epoch 8565
Loss = 5.8689e-02, PNorm = 827.7788, GNorm = 2.5546, lr_0 = 9.9399e-04
Validation auc = 0.684160
Epoch 8566
Loss = 5.1878e-02, PNorm = 827.8833, GNorm = 2.0997, lr_0 = 9.9399e-04
Validation auc = 0.685017
Epoch 8567
Loss = 7.3314e-02, PNorm = 827.9621, GNorm = 2.9388, lr_0 = 9.9399e-04
Validation auc = 0.683850
Epoch 8568
Loss = 2.0411e-02, PNorm = 828.0172, GNorm = 0.6206, lr_0 = 9.9399e-04
Validation auc = 0.684317
Epoch 8569
Loss = 1.4985e-02, PNorm = 828.0731, GNorm = 0.7478, lr_0 = 9.9399e-04
Loss = 1.4941e-01, PNorm = 828.1395, GNorm = 2.2441, lr_0 = 9.9399e-04
Validation auc = 0.677912
Epoch 8570
Loss = 8.7366e-02, PNorm = 828.2097, GNorm = 6.2167, lr_0 = 9.9399e-04
Validation auc = 0.677161
Epoch 8571
Loss = 6.1290e-02, PNorm = 828.2778, GNorm = 0.6018, lr_0 = 9.9399e-04
Validation auc = 0.666383
Epoch 8572
Loss = 1.1758e-01, PNorm = 828.3444, GNorm = 5.4427, lr_0 = 9.9399e-04
Validation auc = 0.659357
Epoch 8573
Loss = 9.6038e-02, PNorm = 828.4150, GNorm = 0.8800, lr_0 = 9.9399e-04
Validation auc = 0.641746
Epoch 8574
Loss = 8.3283e-02, PNorm = 828.4791, GNorm = 2.1156, lr_0 = 9.9398e-04
Validation auc = 0.646881
Epoch 8575
Loss = 9.6086e-02, PNorm = 828.5364, GNorm = 7.4318, lr_0 = 9.9398e-04
Validation auc = 0.664888
Epoch 8576
Loss = 3.0130e-02, PNorm = 828.5935, GNorm = 0.8836, lr_0 = 9.9398e-04
Validation auc = 0.681962
Epoch 8577
Loss = 4.5810e-02, PNorm = 828.6315, GNorm = 1.3894, lr_0 = 9.9398e-04
Validation auc = 0.680332
Epoch 8578
Loss = 1.6197e-01, PNorm = 828.6714, GNorm = 8.0434, lr_0 = 9.9398e-04
Validation auc = 0.672342
Epoch 8579
Loss = 7.5539e-02, PNorm = 828.7327, GNorm = 2.8052, lr_0 = 9.9398e-04
Loss = 7.5643e-02, PNorm = 828.7986, GNorm = 2.6186, lr_0 = 9.9398e-04
Validation auc = 0.682287
Epoch 8580
Loss = 7.5336e-02, PNorm = 828.8596, GNorm = 2.7969, lr_0 = 9.9398e-04
Validation auc = 0.695859
Epoch 8581
Loss = 5.7555e-02, PNorm = 828.9056, GNorm = 2.1856, lr_0 = 9.9398e-04
Validation auc = 0.702367
Epoch 8582
Loss = 3.6115e-02, PNorm = 828.9495, GNorm = 0.9770, lr_0 = 9.9398e-04
Validation auc = 0.705829
Epoch 8583
Loss = 1.7098e-02, PNorm = 828.9842, GNorm = 0.4459, lr_0 = 9.9398e-04
Validation auc = 0.707195
Epoch 8584
Loss = 2.6144e-02, PNorm = 829.0150, GNorm = 0.0902, lr_0 = 9.9398e-04
Validation auc = 0.709540
Epoch 8585
Loss = 1.1253e-01, PNorm = 829.0467, GNorm = 3.6405, lr_0 = 9.9398e-04
Validation auc = 0.710553
Epoch 8586
Loss = 6.8616e-02, PNorm = 829.0762, GNorm = 2.0511, lr_0 = 9.9398e-04
Validation auc = 0.711948
Epoch 8587
Loss = 3.4110e-02, PNorm = 829.1136, GNorm = 0.7561, lr_0 = 9.9398e-04
Validation auc = 0.709923
Epoch 8588
Loss = 4.5502e-02, PNorm = 829.1579, GNorm = 0.7314, lr_0 = 9.9397e-04
Validation auc = 0.706482
Epoch 8589
Loss = 1.2216e-02, PNorm = 829.1949, GNorm = 0.5603, lr_0 = 9.9397e-04
Loss = 5.4289e-02, PNorm = 829.2324, GNorm = 1.4383, lr_0 = 9.9397e-04
Validation auc = 0.701518
Epoch 8590
Loss = 5.6390e-02, PNorm = 829.2716, GNorm = 1.0197, lr_0 = 9.9397e-04
Validation auc = 0.691338
Epoch 8591
Loss = 3.3833e-02, PNorm = 829.3071, GNorm = 0.8902, lr_0 = 9.9397e-04
Validation auc = 0.692023
Epoch 8592
Loss = 4.5363e-02, PNorm = 829.3352, GNorm = 2.1043, lr_0 = 9.9397e-04
Validation auc = 0.691854
Epoch 8593
Loss = 1.9113e-02, PNorm = 829.3600, GNorm = 0.3414, lr_0 = 9.9397e-04
Validation auc = 0.697784
Epoch 8594
Loss = 3.0921e-02, PNorm = 829.3870, GNorm = 3.8775, lr_0 = 9.9397e-04
Validation auc = 0.702563
Epoch 8595
Loss = 3.2617e-02, PNorm = 829.4139, GNorm = 3.8721, lr_0 = 9.9397e-04
Validation auc = 0.705211
Epoch 8596
Loss = 2.4175e-02, PNorm = 829.4401, GNorm = 0.3830, lr_0 = 9.9397e-04
Validation auc = 0.702231
Epoch 8597
Loss = 5.9715e-03, PNorm = 829.4639, GNorm = 0.1471, lr_0 = 9.9397e-04
Validation auc = 0.701653
Epoch 8598
Loss = 1.7358e-02, PNorm = 829.4837, GNorm = 1.6795, lr_0 = 9.9397e-04
Validation auc = 0.698884
Epoch 8599
Loss = 3.2666e-03, PNorm = 829.5114, GNorm = 0.2587, lr_0 = 9.9397e-04
Loss = 7.2474e-02, PNorm = 829.5439, GNorm = 0.1240, lr_0 = 9.9397e-04
Validation auc = 0.694933
Epoch 8600
Loss = 4.4468e-02, PNorm = 829.5756, GNorm = 2.1412, lr_0 = 9.9396e-04
Validation auc = 0.693819
Epoch 8601
Loss = 1.6012e-02, PNorm = 829.6005, GNorm = 0.4825, lr_0 = 9.9396e-04
Validation auc = 0.696136
Epoch 8602
Loss = 5.5933e-02, PNorm = 829.6198, GNorm = 10.9196, lr_0 = 9.9396e-04
Validation auc = 0.696231
Epoch 8603
Loss = 4.5853e-02, PNorm = 829.6483, GNorm = 1.1761, lr_0 = 9.9396e-04
Validation auc = 0.691623
Epoch 8604
Loss = 3.9670e-02, PNorm = 829.6827, GNorm = 1.0536, lr_0 = 9.9396e-04
Validation auc = 0.687582
Epoch 8605
Loss = 1.1388e-02, PNorm = 829.7098, GNorm = 0.6975, lr_0 = 9.9396e-04
Validation auc = 0.682314
Epoch 8606
Loss = 6.7108e-02, PNorm = 829.7386, GNorm = 0.2162, lr_0 = 9.9396e-04
Validation auc = 0.682297
Epoch 8607
Loss = 4.8142e-02, PNorm = 829.7805, GNorm = 3.0506, lr_0 = 9.9396e-04
Validation auc = 0.682262
Epoch 8608
Loss = 1.7140e-02, PNorm = 829.8124, GNorm = 2.5531, lr_0 = 9.9396e-04
Validation auc = 0.675372
Epoch 8609
Loss = 1.9248e-03, PNorm = 829.8481, GNorm = 0.1480, lr_0 = 9.9396e-04
Loss = 6.5093e-02, PNorm = 829.8804, GNorm = 0.8153, lr_0 = 9.9396e-04
Validation auc = 0.674650
Epoch 8610
Loss = 3.8512e-02, PNorm = 829.9141, GNorm = 13.0541, lr_0 = 9.9396e-04
Validation auc = 0.673687
Epoch 8611
Loss = 2.5891e-02, PNorm = 829.9598, GNorm = 1.2484, lr_0 = 9.9396e-04
Validation auc = 0.677670
Epoch 8612
Loss = 1.5891e-01, PNorm = 830.0020, GNorm = 0.2035, lr_0 = 9.9396e-04
Validation auc = 0.683145
Epoch 8613
Loss = 5.3121e-02, PNorm = 830.0556, GNorm = 1.0662, lr_0 = 9.9396e-04
Validation auc = 0.682460
Epoch 8614
Loss = 3.5533e-02, PNorm = 830.0981, GNorm = 5.3452, lr_0 = 9.9395e-04
Validation auc = 0.685700
Epoch 8615
Loss = 1.4341e-01, PNorm = 830.1369, GNorm = 23.2533, lr_0 = 9.9395e-04
Validation auc = 0.688676
Epoch 8616
Loss = 7.5926e-02, PNorm = 830.1925, GNorm = 5.3277, lr_0 = 9.9395e-04
Validation auc = 0.693116
Epoch 8617
Loss = 4.7108e-02, PNorm = 830.2423, GNorm = 0.5680, lr_0 = 9.9395e-04
Validation auc = 0.696318
Epoch 8618
Loss = 9.4316e-02, PNorm = 830.2822, GNorm = 7.8363, lr_0 = 9.9395e-04
Validation auc = 0.690819
Epoch 8619
Loss = 3.7088e-03, PNorm = 830.3240, GNorm = 0.2699, lr_0 = 9.9395e-04
Loss = 5.7381e-02, PNorm = 830.3720, GNorm = 1.3586, lr_0 = 9.9395e-04
Validation auc = 0.689189
Epoch 8620
Loss = 3.1072e-02, PNorm = 830.4133, GNorm = 5.4743, lr_0 = 9.9395e-04
Validation auc = 0.692890
Epoch 8621
Loss = 4.6020e-02, PNorm = 830.4526, GNorm = 0.3671, lr_0 = 9.9395e-04
Validation auc = 0.694062
Epoch 8622
Loss = 3.1053e-02, PNorm = 830.4869, GNorm = 2.6061, lr_0 = 9.9395e-04
Validation auc = 0.696366
Epoch 8623
Loss = 3.3281e-02, PNorm = 830.5151, GNorm = 0.1945, lr_0 = 9.9395e-04
Validation auc = 0.699662
Epoch 8624
Loss = 1.1652e-01, PNorm = 830.5400, GNorm = 2.9442, lr_0 = 9.9395e-04
Validation auc = 0.697725
Epoch 8625
Loss = 2.0178e-02, PNorm = 830.5656, GNorm = 4.7230, lr_0 = 9.9395e-04
Validation auc = 0.694771
Epoch 8626
Loss = 1.7509e-02, PNorm = 830.5889, GNorm = 1.0414, lr_0 = 9.9395e-04
Validation auc = 0.691002
Epoch 8627
Loss = 3.9660e-02, PNorm = 830.6086, GNorm = 8.8624, lr_0 = 9.9395e-04
Validation auc = 0.689818
Epoch 8628
Loss = 3.7089e-02, PNorm = 830.6404, GNorm = 0.9056, lr_0 = 9.9394e-04
Validation auc = 0.683620
Epoch 8629
Loss = 1.5922e-02, PNorm = 830.6783, GNorm = 1.4181, lr_0 = 9.9394e-04
Loss = 2.9801e-02, PNorm = 830.7070, GNorm = 4.7213, lr_0 = 9.9394e-04
Validation auc = 0.681965
Epoch 8630
Loss = 1.8879e-02, PNorm = 830.7347, GNorm = 1.2805, lr_0 = 9.9394e-04
Validation auc = 0.679766
Epoch 8631
Loss = 5.7922e-02, PNorm = 830.7616, GNorm = 3.3280, lr_0 = 9.9394e-04
Validation auc = 0.679918
Epoch 8632
Loss = 7.2604e-02, PNorm = 830.7926, GNorm = 0.2301, lr_0 = 9.9394e-04
Validation auc = 0.685360
Epoch 8633
Loss = 3.7251e-02, PNorm = 830.8207, GNorm = 0.2788, lr_0 = 9.9394e-04
Validation auc = 0.688304
Epoch 8634
Loss = 2.0457e-02, PNorm = 830.8519, GNorm = 1.8139, lr_0 = 9.9394e-04
Validation auc = 0.689543
Epoch 8635
Loss = 5.3713e-02, PNorm = 830.8837, GNorm = 2.8591, lr_0 = 9.9394e-04
Validation auc = 0.691266
Epoch 8636
Loss = 3.3858e-02, PNorm = 830.9112, GNorm = 4.3730, lr_0 = 9.9394e-04
Validation auc = 0.692809
Epoch 8637
Loss = 2.7376e-02, PNorm = 830.9879, GNorm = 0.9113, lr_0 = 9.9394e-04
Validation auc = 0.693506
Epoch 8638
Loss = 2.7103e-02, PNorm = 831.0539, GNorm = 1.6872, lr_0 = 9.9394e-04
Validation auc = 0.696139
Epoch 8639
Loss = 1.5713e-02, PNorm = 831.1090, GNorm = 0.4974, lr_0 = 9.9394e-04
Loss = 8.7454e-02, PNorm = 831.1582, GNorm = 4.4570, lr_0 = 9.9394e-04
Validation auc = 0.694956
Epoch 8640
Loss = 1.2631e-01, PNorm = 831.2238, GNorm = 7.8038, lr_0 = 9.9393e-04
Validation auc = 0.683554
Epoch 8641
Loss = 6.3928e-02, PNorm = 831.2996, GNorm = 1.1226, lr_0 = 9.9393e-04
Validation auc = 0.676573
Epoch 8642
Loss = 7.9441e-02, PNorm = 831.3649, GNorm = 2.5861, lr_0 = 9.9393e-04
Validation auc = 0.674236
Epoch 8643
Loss = 6.0298e-02, PNorm = 831.4195, GNorm = 1.1004, lr_0 = 9.9393e-04
Validation auc = 0.686698
Epoch 8644
Loss = 8.4384e-02, PNorm = 831.4714, GNorm = 0.5968, lr_0 = 9.9393e-04
Validation auc = 0.698752
Epoch 8645
Loss = 4.2606e-02, PNorm = 831.5470, GNorm = 2.4815, lr_0 = 9.9393e-04
Validation auc = 0.699369
Epoch 8646
Loss = 3.2606e-02, PNorm = 831.6125, GNorm = 0.8848, lr_0 = 9.9393e-04
Validation auc = 0.698753
Epoch 8647
Loss = 5.5546e-02, PNorm = 831.6639, GNorm = 1.6995, lr_0 = 9.9393e-04
Validation auc = 0.700927
Epoch 8648
Loss = 1.9620e-02, PNorm = 831.7026, GNorm = 0.8109, lr_0 = 9.9393e-04
Validation auc = 0.700191
Epoch 8649
Loss = 5.3170e-02, PNorm = 831.7524, GNorm = 6.9691, lr_0 = 9.9393e-04
Loss = 5.3822e-02, PNorm = 831.8162, GNorm = 0.6196, lr_0 = 9.9393e-04
Validation auc = 0.699619
Epoch 8650
Loss = 8.0061e-02, PNorm = 831.8787, GNorm = 0.4946, lr_0 = 9.9393e-04
Validation auc = 0.692574
Epoch 8651
Loss = 3.4147e-02, PNorm = 831.9248, GNorm = 1.1606, lr_0 = 9.9393e-04
Validation auc = 0.698797
Epoch 8652
Loss = 3.0678e-02, PNorm = 831.9609, GNorm = 0.6357, lr_0 = 9.9393e-04
Validation auc = 0.704884
Epoch 8653
Loss = 2.6359e-02, PNorm = 832.0008, GNorm = 2.5269, lr_0 = 9.9393e-04
Validation auc = 0.712612
Epoch 8654
Loss = 6.5484e-02, PNorm = 832.0433, GNorm = 3.4156, lr_0 = 9.9392e-04
Validation auc = 0.709120
Epoch 8655
Loss = 6.0702e-02, PNorm = 832.0905, GNorm = 2.4052, lr_0 = 9.9392e-04
Validation auc = 0.704004
Epoch 8656
Loss = 5.3217e-02, PNorm = 832.1338, GNorm = 0.4624, lr_0 = 9.9392e-04
Validation auc = 0.700653
Epoch 8657
Loss = 1.2419e-02, PNorm = 832.1768, GNorm = 0.2548, lr_0 = 9.9392e-04
Validation auc = 0.691244
Epoch 8658
Loss = 4.0672e-02, PNorm = 832.2237, GNorm = 1.5046, lr_0 = 9.9392e-04
Validation auc = 0.686056
Epoch 8659
Loss = 1.0169e+00, PNorm = 832.2712, GNorm = 38.0304, lr_0 = 9.9392e-04
Loss = 4.7406e-02, PNorm = 832.3254, GNorm = 1.8421, lr_0 = 9.9392e-04
Validation auc = 0.688845
Epoch 8660
Loss = 1.5250e-01, PNorm = 832.3961, GNorm = 17.9062, lr_0 = 9.9392e-04
Validation auc = 0.688963
Epoch 8661
Loss = 8.9227e-02, PNorm = 832.4811, GNorm = 1.9678, lr_0 = 9.9392e-04
Validation auc = 0.694274
Epoch 8662
Loss = 5.7410e-02, PNorm = 832.5537, GNorm = 3.6536, lr_0 = 9.9392e-04
Validation auc = 0.684448
Epoch 8663
Loss = 5.3480e-02, PNorm = 832.6177, GNorm = 3.4013, lr_0 = 9.9392e-04
Validation auc = 0.680216
Epoch 8664
Loss = 4.8854e-02, PNorm = 832.6732, GNorm = 2.3796, lr_0 = 9.9392e-04
Validation auc = 0.676567
Epoch 8665
Loss = 8.6746e-02, PNorm = 832.7223, GNorm = 6.2732, lr_0 = 9.9392e-04
Validation auc = 0.670419
Epoch 8666
Loss = 5.3609e-02, PNorm = 832.7660, GNorm = 2.5486, lr_0 = 9.9392e-04
Validation auc = 0.679438
Epoch 8667
Loss = 4.0865e-02, PNorm = 832.8091, GNorm = 0.5655, lr_0 = 9.9391e-04
Validation auc = 0.682417
Epoch 8668
Loss = 8.6119e-02, PNorm = 832.8473, GNorm = 5.9273, lr_0 = 9.9391e-04
Validation auc = 0.687770
Epoch 8669
Loss = 3.3724e-03, PNorm = 832.8802, GNorm = 0.2445, lr_0 = 9.9391e-04
Loss = 6.6153e-02, PNorm = 832.9191, GNorm = 1.4125, lr_0 = 9.9391e-04
Validation auc = 0.693477
Epoch 8670
Loss = 2.7940e-02, PNorm = 832.9615, GNorm = 0.5210, lr_0 = 9.9391e-04
Validation auc = 0.691806
Epoch 8671
Loss = 4.0937e-02, PNorm = 832.9922, GNorm = 2.4535, lr_0 = 9.9391e-04
Validation auc = 0.694736
Epoch 8672
Loss = 2.9184e-02, PNorm = 833.0232, GNorm = 1.7182, lr_0 = 9.9391e-04
Validation auc = 0.701552
Epoch 8673
Loss = 2.8172e-02, PNorm = 833.0498, GNorm = 0.1189, lr_0 = 9.9391e-04
Validation auc = 0.704039
Epoch 8674
Loss = 8.8171e-02, PNorm = 833.0764, GNorm = 5.6749, lr_0 = 9.9391e-04
Validation auc = 0.698714
Epoch 8675
Loss = 2.6454e-02, PNorm = 833.1101, GNorm = 0.2601, lr_0 = 9.9391e-04
Validation auc = 0.694355
Epoch 8676
Loss = 6.2491e-02, PNorm = 833.1463, GNorm = 3.4656, lr_0 = 9.9391e-04
Validation auc = 0.697534
Epoch 8677
Loss = 7.2790e-02, PNorm = 833.1867, GNorm = 1.3657, lr_0 = 9.9391e-04
Validation auc = 0.704152
Epoch 8678
Loss = 1.5304e-02, PNorm = 833.2371, GNorm = 0.2962, lr_0 = 9.9391e-04
Validation auc = 0.705001
Epoch 8679
Loss = 3.3769e-02, PNorm = 833.2767, GNorm = 2.6952, lr_0 = 9.9391e-04
Loss = 2.8818e-02, PNorm = 833.3098, GNorm = 1.9585, lr_0 = 9.9391e-04
Validation auc = 0.706817
Epoch 8680
Loss = 2.3968e-01, PNorm = 833.3562, GNorm = 50.2887, lr_0 = 9.9390e-04
Validation auc = 0.708013
Epoch 8681
Loss = 7.1959e-02, PNorm = 833.4183, GNorm = 3.8930, lr_0 = 9.9390e-04
Validation auc = 0.704277
Epoch 8682
Loss = 4.7116e-02, PNorm = 833.4818, GNorm = 0.6749, lr_0 = 9.9390e-04
Validation auc = 0.706898
Epoch 8683
Loss = 2.4251e-02, PNorm = 833.5347, GNorm = 0.5514, lr_0 = 9.9390e-04
Validation auc = 0.710412
Epoch 8684
Loss = 3.5288e-02, PNorm = 833.5769, GNorm = 2.5139, lr_0 = 9.9390e-04
Validation auc = 0.700350
Epoch 8685
Loss = 7.7334e-02, PNorm = 833.6213, GNorm = 4.3404, lr_0 = 9.9390e-04
Validation auc = 0.693898
Epoch 8686
Loss = 2.1924e-02, PNorm = 833.6666, GNorm = 1.7794, lr_0 = 9.9390e-04
Validation auc = 0.693835
Epoch 8687
Loss = 2.9267e-02, PNorm = 833.7006, GNorm = 2.6965, lr_0 = 9.9390e-04
Validation auc = 0.696230
Epoch 8688
Loss = 1.0607e-02, PNorm = 833.7368, GNorm = 1.2529, lr_0 = 9.9390e-04
Validation auc = 0.697298
Epoch 8689
Loss = 8.6635e-02, PNorm = 833.7789, GNorm = 2.9853, lr_0 = 9.9390e-04
Loss = 4.6063e-02, PNorm = 833.8216, GNorm = 2.3205, lr_0 = 9.9390e-04
Validation auc = 0.701256
Epoch 8690
Loss = 9.9944e-02, PNorm = 833.8731, GNorm = 1.1312, lr_0 = 9.9390e-04
Validation auc = 0.692183
Epoch 8691
Loss = 6.7600e-02, PNorm = 833.9351, GNorm = 1.8982, lr_0 = 9.9390e-04
Validation auc = 0.695505
Epoch 8692
Loss = 3.2073e-02, PNorm = 833.9920, GNorm = 3.7535, lr_0 = 9.9390e-04
Validation auc = 0.700330
Epoch 8693
Loss = 5.3376e-02, PNorm = 834.0387, GNorm = 1.3397, lr_0 = 9.9390e-04
Validation auc = 0.709886
Epoch 8694
Loss = 4.0576e-02, PNorm = 834.0904, GNorm = 0.5137, lr_0 = 9.9389e-04
Validation auc = 0.717284
Epoch 8695
Loss = 1.5510e-02, PNorm = 834.1277, GNorm = 0.5879, lr_0 = 9.9389e-04
Validation auc = 0.714678
Epoch 8696
Loss = 5.1069e-02, PNorm = 834.1558, GNorm = 2.2506, lr_0 = 9.9389e-04
Validation auc = 0.709755
Epoch 8697
Loss = 5.3429e-02, PNorm = 834.1839, GNorm = 6.0904, lr_0 = 9.9389e-04
Validation auc = 0.702518
Epoch 8698
Loss = 1.4078e-01, PNorm = 834.2277, GNorm = 14.2801, lr_0 = 9.9389e-04
Validation auc = 0.693635
Epoch 8699
Loss = 1.0470e-02, PNorm = 834.2763, GNorm = 2.4875, lr_0 = 9.9389e-04
Loss = 8.1241e-02, PNorm = 834.3146, GNorm = 7.8498, lr_0 = 9.9389e-04
Validation auc = 0.689881
Epoch 8700
Loss = 5.1152e-02, PNorm = 834.3465, GNorm = 0.6033, lr_0 = 9.9389e-04
Validation auc = 0.695642
Epoch 8701
Loss = 7.3238e-02, PNorm = 834.3840, GNorm = 0.5947, lr_0 = 9.9389e-04
Validation auc = 0.701624
Epoch 8702
Loss = 5.7496e-02, PNorm = 834.4291, GNorm = 2.5222, lr_0 = 9.9389e-04
Validation auc = 0.703797
Epoch 8703
Loss = 2.3175e-02, PNorm = 834.4686, GNorm = 0.8786, lr_0 = 9.9389e-04
Validation auc = 0.706600
Epoch 8704
Loss = 4.6685e-02, PNorm = 834.5053, GNorm = 3.2500, lr_0 = 9.9389e-04
Validation auc = 0.706242
Epoch 8705
Loss = 7.2157e-02, PNorm = 834.5448, GNorm = 1.0675, lr_0 = 9.9389e-04
Validation auc = 0.710581
Epoch 8706
Loss = 4.6729e-02, PNorm = 834.5816, GNorm = 0.8707, lr_0 = 9.9389e-04
Validation auc = 0.710887
Epoch 8707
Loss = 2.5290e-02, PNorm = 834.6114, GNorm = 2.2145, lr_0 = 9.9388e-04
Validation auc = 0.711654
Epoch 8708
Loss = 2.4904e-02, PNorm = 834.6361, GNorm = 0.8120, lr_0 = 9.9388e-04
Validation auc = 0.712374
Epoch 8709
Loss = 3.4941e-02, PNorm = 834.6580, GNorm = 1.9761, lr_0 = 9.9388e-04
Loss = 7.0630e-02, PNorm = 834.6820, GNorm = 2.7763, lr_0 = 9.9388e-04
Validation auc = 0.712442
Epoch 8710
Loss = 6.2031e-02, PNorm = 834.7162, GNorm = 1.1371, lr_0 = 9.9388e-04
Validation auc = 0.721695
Epoch 8711
Loss = 4.2853e-02, PNorm = 834.7474, GNorm = 0.7306, lr_0 = 9.9388e-04
Validation auc = 0.722280
Epoch 8712
Loss = 5.2959e-02, PNorm = 834.7755, GNorm = 1.0793, lr_0 = 9.9388e-04
Validation auc = 0.721296
Epoch 8713
Loss = 5.6541e-02, PNorm = 834.8068, GNorm = 4.6640, lr_0 = 9.9388e-04
Validation auc = 0.718679
Epoch 8714
Loss = 4.9572e-02, PNorm = 834.8444, GNorm = 0.4461, lr_0 = 9.9388e-04
Validation auc = 0.713909
Epoch 8715
Loss = 5.7252e-02, PNorm = 834.8870, GNorm = 1.0523, lr_0 = 9.9388e-04
Validation auc = 0.712356
Epoch 8716
Loss = 3.5456e-02, PNorm = 834.9363, GNorm = 3.2888, lr_0 = 9.9388e-04
Validation auc = 0.709996
Epoch 8717
Loss = 3.3755e-02, PNorm = 834.9856, GNorm = 2.3008, lr_0 = 9.9388e-04
Validation auc = 0.712797
Epoch 8718
Loss = 6.0757e-02, PNorm = 835.0252, GNorm = 6.4251, lr_0 = 9.9388e-04
Validation auc = 0.711741
Epoch 8719
Loss = 1.3668e-01, PNorm = 835.0682, GNorm = 5.0862, lr_0 = 9.9388e-04
Loss = 1.9721e-02, PNorm = 835.1088, GNorm = 0.1898, lr_0 = 9.9388e-04
Validation auc = 0.712002
Epoch 8720
Loss = 4.0403e-02, PNorm = 835.1445, GNorm = 2.6584, lr_0 = 9.9387e-04
Validation auc = 0.715202
Epoch 8721
Loss = 7.3141e-02, PNorm = 835.1803, GNorm = 1.0029, lr_0 = 9.9387e-04
Validation auc = 0.712474
Epoch 8722
Loss = 5.2935e-02, PNorm = 835.2266, GNorm = 1.2887, lr_0 = 9.9387e-04
Validation auc = 0.706582
Epoch 8723
Loss = 8.5287e-02, PNorm = 835.2703, GNorm = 1.3073, lr_0 = 9.9387e-04
Validation auc = 0.706626
Epoch 8724
Loss = 2.5719e-02, PNorm = 835.3099, GNorm = 0.8520, lr_0 = 9.9387e-04
Validation auc = 0.705321
Epoch 8725
Loss = 4.9360e-02, PNorm = 835.3382, GNorm = 6.5054, lr_0 = 9.9387e-04
Validation auc = 0.706456
Epoch 8726
Loss = 4.0448e-02, PNorm = 835.3638, GNorm = 0.1061, lr_0 = 9.9387e-04
Validation auc = 0.700782
Epoch 8727
Loss = 4.2661e-02, PNorm = 835.3901, GNorm = 2.0284, lr_0 = 9.9387e-04
Validation auc = 0.699058
Epoch 8728
Loss = 6.4687e-03, PNorm = 835.4159, GNorm = 0.6073, lr_0 = 9.9387e-04
Validation auc = 0.696135
Epoch 8729
Loss = 5.1818e-03, PNorm = 835.4328, GNorm = 0.3400, lr_0 = 9.9387e-04
Loss = 1.4207e-02, PNorm = 835.4516, GNorm = 2.8225, lr_0 = 9.9387e-04
Validation auc = 0.695014
Epoch 8730
Loss = 3.2156e-02, PNorm = 835.4732, GNorm = 0.8592, lr_0 = 9.9387e-04
Validation auc = 0.695047
Epoch 8731
Loss = 4.0754e-02, PNorm = 835.5044, GNorm = 3.5083, lr_0 = 9.9387e-04
Validation auc = 0.699137
Epoch 8732
Loss = 3.2058e-02, PNorm = 835.5359, GNorm = 4.6561, lr_0 = 9.9387e-04
Validation auc = 0.703702
Epoch 8733
Loss = 2.4076e-02, PNorm = 835.5575, GNorm = 2.5437, lr_0 = 9.9386e-04
Validation auc = 0.705014
Epoch 8734
Loss = 2.4225e-02, PNorm = 835.5763, GNorm = 2.3044, lr_0 = 9.9386e-04
Validation auc = 0.703041
Epoch 8735
Loss = 1.8367e-01, PNorm = 835.6098, GNorm = 6.2701, lr_0 = 9.9386e-04
Validation auc = 0.698179
Epoch 8736
Loss = 2.4719e-02, PNorm = 835.6634, GNorm = 1.2203, lr_0 = 9.9386e-04
Validation auc = 0.698635
Epoch 8737
Loss = 3.1939e-02, PNorm = 835.7160, GNorm = 1.1289, lr_0 = 9.9386e-04
Validation auc = 0.702131
Epoch 8738
Loss = 7.7741e-02, PNorm = 835.7637, GNorm = 2.8629, lr_0 = 9.9386e-04
Validation auc = 0.700933
Epoch 8739
Loss = 6.6115e-03, PNorm = 835.8123, GNorm = 0.3353, lr_0 = 9.9386e-04
Loss = 5.6253e-02, PNorm = 835.8500, GNorm = 1.4177, lr_0 = 9.9386e-04
Validation auc = 0.695895
Epoch 8740
Loss = 3.9460e-02, PNorm = 835.8820, GNorm = 0.5100, lr_0 = 9.9386e-04
Validation auc = 0.691309
Epoch 8741
Loss = 3.9178e-02, PNorm = 835.9139, GNorm = 2.4241, lr_0 = 9.9386e-04
Validation auc = 0.693755
Epoch 8742
Loss = 4.9133e-02, PNorm = 835.9430, GNorm = 0.3657, lr_0 = 9.9386e-04
Validation auc = 0.696557
Epoch 8743
Loss = 9.8672e-03, PNorm = 835.9734, GNorm = 0.3786, lr_0 = 9.9386e-04
Validation auc = 0.696587
Epoch 8744
Loss = 9.9293e-02, PNorm = 836.0052, GNorm = 6.5081, lr_0 = 9.9386e-04
Validation auc = 0.696385
Epoch 8745
Loss = 2.9734e-02, PNorm = 836.0426, GNorm = 0.5988, lr_0 = 9.9386e-04
Validation auc = 0.698344
Epoch 8746
Loss = 8.3207e-02, PNorm = 836.0773, GNorm = 2.0691, lr_0 = 9.9386e-04
Validation auc = 0.696599
Epoch 8747
Loss = 3.9255e-02, PNorm = 836.1142, GNorm = 0.7776, lr_0 = 9.9385e-04
Validation auc = 0.696454
Epoch 8748
Loss = 4.1473e-02, PNorm = 836.1493, GNorm = 1.9036, lr_0 = 9.9385e-04
Validation auc = 0.699078
Epoch 8749
Loss = 2.7841e-02, PNorm = 836.1879, GNorm = 0.6733, lr_0 = 9.9385e-04
Loss = 5.0882e-02, PNorm = 836.2237, GNorm = 0.9496, lr_0 = 9.9385e-04
Validation auc = 0.705068
Epoch 8750
Loss = 1.9033e-02, PNorm = 836.2595, GNorm = 0.6202, lr_0 = 9.9385e-04
Validation auc = 0.707667
Epoch 8751
Loss = 3.0610e-02, PNorm = 836.2860, GNorm = 1.2557, lr_0 = 9.9385e-04
Validation auc = 0.709782
Epoch 8752
Loss = 7.3601e-02, PNorm = 836.3121, GNorm = 0.3691, lr_0 = 9.9385e-04
Validation auc = 0.699916
Epoch 8753
Loss = 5.1980e-02, PNorm = 836.3557, GNorm = 2.5273, lr_0 = 9.9385e-04
Validation auc = 0.687405
Epoch 8754
Loss = 4.0597e-02, PNorm = 836.3993, GNorm = 4.2533, lr_0 = 9.9385e-04
Validation auc = 0.682407
Epoch 8755
Loss = 4.4673e-02, PNorm = 836.4313, GNorm = 0.2884, lr_0 = 9.9385e-04
Validation auc = 0.677968
Epoch 8756
Loss = 3.6329e-02, PNorm = 836.4617, GNorm = 3.5549, lr_0 = 9.9385e-04
Validation auc = 0.671051
Epoch 8757
Loss = 2.4734e-02, PNorm = 836.4948, GNorm = 0.6272, lr_0 = 9.9385e-04
Validation auc = 0.677301
Epoch 8758
Loss = 1.7523e-02, PNorm = 836.5339, GNorm = 0.7663, lr_0 = 9.9385e-04
Validation auc = 0.681294
Epoch 8759
Loss = 3.8702e-03, PNorm = 836.5737, GNorm = 0.2160, lr_0 = 9.9385e-04
Loss = 3.6594e-02, PNorm = 836.6069, GNorm = 2.3299, lr_0 = 9.9385e-04
Validation auc = 0.682080
Epoch 8760
Loss = 5.6676e-02, PNorm = 836.6395, GNorm = 10.9570, lr_0 = 9.9384e-04
Validation auc = 0.685437
Epoch 8761
Loss = 3.1095e-02, PNorm = 836.6680, GNorm = 2.5563, lr_0 = 9.9384e-04
Validation auc = 0.684951
Epoch 8762
Loss = 3.6585e-02, PNorm = 836.6948, GNorm = 0.2998, lr_0 = 9.9384e-04
Validation auc = 0.682245
Epoch 8763
Loss = 7.4258e-02, PNorm = 836.7242, GNorm = 2.2851, lr_0 = 9.9384e-04
Validation auc = 0.685067
Epoch 8764
Loss = 3.4569e-02, PNorm = 836.7591, GNorm = 0.9644, lr_0 = 9.9384e-04
Validation auc = 0.689409
Epoch 8765
Loss = 2.8163e-02, PNorm = 836.7947, GNorm = 0.8984, lr_0 = 9.9384e-04
Validation auc = 0.689906
Epoch 8766
Loss = 4.9400e-02, PNorm = 836.8321, GNorm = 3.2110, lr_0 = 9.9384e-04
Validation auc = 0.692509
Epoch 8767
Loss = 3.4034e-02, PNorm = 836.8758, GNorm = 0.9107, lr_0 = 9.9384e-04
Validation auc = 0.693207
Epoch 8768
Loss = 3.3417e-02, PNorm = 836.9196, GNorm = 2.8025, lr_0 = 9.9384e-04
Validation auc = 0.696928
Epoch 8769
Loss = 2.4198e-02, PNorm = 836.9566, GNorm = 1.6494, lr_0 = 9.9384e-04
Loss = 4.1797e-02, PNorm = 836.9930, GNorm = 1.1477, lr_0 = 9.9384e-04
Validation auc = 0.703254
Epoch 8770
Loss = 1.1737e-02, PNorm = 837.0208, GNorm = 0.3678, lr_0 = 9.9384e-04
Validation auc = 0.703494
Epoch 8771
Loss = 8.5819e-02, PNorm = 837.0445, GNorm = 0.9649, lr_0 = 9.9384e-04
Validation auc = 0.695368
Epoch 8772
Loss = 2.4539e-02, PNorm = 837.0681, GNorm = 0.7559, lr_0 = 9.9384e-04
Validation auc = 0.692565
Epoch 8773
Loss = 2.7469e-02, PNorm = 837.0854, GNorm = 0.6421, lr_0 = 9.9383e-04
Validation auc = 0.692361
Epoch 8774
Loss = 9.4483e-02, PNorm = 837.1092, GNorm = 8.9637, lr_0 = 9.9383e-04
Validation auc = 0.693023
Epoch 8775
Loss = 8.5573e-02, PNorm = 837.1377, GNorm = 9.7702, lr_0 = 9.9383e-04
Validation auc = 0.697031
Epoch 8776
Loss = 6.0420e-02, PNorm = 837.1889, GNorm = 0.9264, lr_0 = 9.9383e-04
Validation auc = 0.701525
Epoch 8777
Loss = 2.5068e-02, PNorm = 837.2342, GNorm = 2.0248, lr_0 = 9.9383e-04
Validation auc = 0.705840
Epoch 8778
Loss = 2.8897e-02, PNorm = 837.2682, GNorm = 1.1234, lr_0 = 9.9383e-04
Validation auc = 0.707618
Epoch 8779
Loss = 2.1031e-03, PNorm = 837.2983, GNorm = 0.1726, lr_0 = 9.9383e-04
Loss = 2.2756e-02, PNorm = 837.3227, GNorm = 5.4787, lr_0 = 9.9383e-04
Validation auc = 0.706265
Epoch 8780
Loss = 3.5341e-02, PNorm = 837.3591, GNorm = 2.2451, lr_0 = 9.9383e-04
Validation auc = 0.703924
Epoch 8781
Loss = 1.5950e-02, PNorm = 837.4187, GNorm = 0.4386, lr_0 = 9.9383e-04
Validation auc = 0.707784
Epoch 8782
Loss = 4.8846e-02, PNorm = 837.4701, GNorm = 0.3422, lr_0 = 9.9383e-04
Validation auc = 0.713858
Epoch 8783
Loss = 3.2112e-01, PNorm = 837.5197, GNorm = 8.3790, lr_0 = 9.9383e-04
Validation auc = 0.703604
Epoch 8784
Loss = 3.8703e-02, PNorm = 837.5825, GNorm = 0.9815, lr_0 = 9.9383e-04
Validation auc = 0.697094
Epoch 8785
Loss = 2.6879e-02, PNorm = 837.6345, GNorm = 1.5993, lr_0 = 9.9383e-04
Validation auc = 0.696278
Epoch 8786
Loss = 6.2006e-02, PNorm = 837.6722, GNorm = 4.2945, lr_0 = 9.9383e-04
Validation auc = 0.698816
Epoch 8787
Loss = 2.4236e-02, PNorm = 837.7117, GNorm = 1.7891, lr_0 = 9.9382e-04
Validation auc = 0.699999
Epoch 8788
Loss = 3.8333e-02, PNorm = 837.7566, GNorm = 0.9685, lr_0 = 9.9382e-04
Validation auc = 0.698036
Epoch 8789
Loss = 1.2929e-02, PNorm = 837.8106, GNorm = 0.5531, lr_0 = 9.9382e-04
Loss = 2.9729e-02, PNorm = 837.8612, GNorm = 0.8375, lr_0 = 9.9382e-04
Validation auc = 0.695488
Epoch 8790
Loss = 3.8480e-02, PNorm = 837.8944, GNorm = 1.9602, lr_0 = 9.9382e-04
Validation auc = 0.699143
Epoch 8791
Loss = 5.9724e-02, PNorm = 837.9272, GNorm = 0.3666, lr_0 = 9.9382e-04
Validation auc = 0.702459
Epoch 8792
Loss = 8.5846e-02, PNorm = 837.9598, GNorm = 0.3683, lr_0 = 9.9382e-04
Validation auc = 0.710928
Epoch 8793
Loss = 3.1143e-02, PNorm = 837.9954, GNorm = 0.9168, lr_0 = 9.9382e-04
Validation auc = 0.714453
Epoch 8794
Loss = 3.2186e-02, PNorm = 838.0244, GNorm = 1.1219, lr_0 = 9.9382e-04
Validation auc = 0.710280
Epoch 8795
Loss = 2.2730e-02, PNorm = 838.0493, GNorm = 0.7107, lr_0 = 9.9382e-04
Validation auc = 0.708924
Epoch 8796
Loss = 1.8471e-02, PNorm = 838.0760, GNorm = 1.0694, lr_0 = 9.9382e-04
Validation auc = 0.712641
Epoch 8797
Loss = 4.7159e-02, PNorm = 838.1053, GNorm = 1.2178, lr_0 = 9.9382e-04
Validation auc = 0.708127
Epoch 8798
Loss = 2.9145e-02, PNorm = 838.1327, GNorm = 3.6396, lr_0 = 9.9382e-04
Validation auc = 0.707395
Epoch 8799
Loss = 1.7195e-03, PNorm = 838.1641, GNorm = 0.1849, lr_0 = 9.9382e-04
Loss = 3.9739e-02, PNorm = 838.1952, GNorm = 0.5065, lr_0 = 9.9382e-04
Validation auc = 0.703989
Epoch 8800
Loss = 1.3622e-02, PNorm = 838.2245, GNorm = 0.3747, lr_0 = 9.9381e-04
Validation auc = 0.700553
Epoch 8801
Loss = 2.3527e-02, PNorm = 838.2432, GNorm = 3.3210, lr_0 = 9.9381e-04
Validation auc = 0.697419
Epoch 8802
Loss = 1.1910e-02, PNorm = 838.2643, GNorm = 0.5889, lr_0 = 9.9381e-04
Validation auc = 0.692705
Epoch 8803
Loss = 7.6097e-02, PNorm = 838.2873, GNorm = 2.0479, lr_0 = 9.9381e-04
Validation auc = 0.688903
Epoch 8804
Loss = 4.2459e-02, PNorm = 838.3141, GNorm = 1.3478, lr_0 = 9.9381e-04
Validation auc = 0.685124
Epoch 8805
Loss = 1.9921e-02, PNorm = 838.3404, GNorm = 1.2042, lr_0 = 9.9381e-04
Validation auc = 0.685593
Epoch 8806
Loss = 1.7283e-02, PNorm = 838.3635, GNorm = 0.3562, lr_0 = 9.9381e-04
Validation auc = 0.683820
Epoch 8807
Loss = 5.0267e-03, PNorm = 838.3880, GNorm = 0.0875, lr_0 = 9.9381e-04
Validation auc = 0.683883
Epoch 8808
Loss = 5.0523e-03, PNorm = 838.4078, GNorm = 0.4615, lr_0 = 9.9381e-04
Validation auc = 0.692964
Epoch 8809
Loss = 1.0451e-03, PNorm = 838.4263, GNorm = 0.1204, lr_0 = 9.9381e-04
Loss = 1.0147e-02, PNorm = 838.4489, GNorm = 0.4279, lr_0 = 9.9381e-04
Validation auc = 0.698912
Epoch 8810
Loss = 4.5370e-02, PNorm = 838.4685, GNorm = 2.8703, lr_0 = 9.9381e-04
Validation auc = 0.698661
Epoch 8811
Loss = 2.6711e-02, PNorm = 838.4886, GNorm = 0.2651, lr_0 = 9.9381e-04
Validation auc = 0.699835
Epoch 8812
Loss = 1.5688e-02, PNorm = 838.5047, GNorm = 0.4944, lr_0 = 9.9381e-04
Validation auc = 0.700380
Epoch 8813
Loss = 2.9269e-02, PNorm = 838.5233, GNorm = 0.3388, lr_0 = 9.9380e-04
Validation auc = 0.698476
Epoch 8814
Loss = 2.0112e-02, PNorm = 838.5431, GNorm = 2.8223, lr_0 = 9.9380e-04
Validation auc = 0.697110
Epoch 8815
Loss = 4.6581e-02, PNorm = 838.5661, GNorm = 0.1968, lr_0 = 9.9380e-04
Validation auc = 0.691143
Epoch 8816
Loss = 8.8538e-02, PNorm = 838.5920, GNorm = 2.2845, lr_0 = 9.9380e-04
Validation auc = 0.686355
Epoch 8817
Loss = 4.8430e-02, PNorm = 838.6345, GNorm = 2.3456, lr_0 = 9.9380e-04
Validation auc = 0.679788
Epoch 8818
Loss = 1.3446e-01, PNorm = 838.6812, GNorm = 6.8291, lr_0 = 9.9380e-04
Validation auc = 0.667486
Epoch 8819
Loss = 1.6119e-02, PNorm = 838.7216, GNorm = 0.7418, lr_0 = 9.9380e-04
Loss = 3.1238e-02, PNorm = 838.7572, GNorm = 0.2764, lr_0 = 9.9380e-04
Validation auc = 0.670975
Epoch 8820
Loss = 3.0235e-02, PNorm = 838.7868, GNorm = 0.3377, lr_0 = 9.9380e-04
Validation auc = 0.676154
Epoch 8821
Loss = 1.2841e-02, PNorm = 838.8102, GNorm = 0.6584, lr_0 = 9.9380e-04
Validation auc = 0.676374
Epoch 8822
Loss = 1.3068e-02, PNorm = 838.8285, GNorm = 0.0939, lr_0 = 9.9380e-04
Validation auc = 0.674002
Epoch 8823
Loss = 3.1099e-02, PNorm = 838.8427, GNorm = 0.0763, lr_0 = 9.9380e-04
Validation auc = 0.673474
Epoch 8824
Loss = 2.6223e-02, PNorm = 838.8605, GNorm = 3.4766, lr_0 = 9.9380e-04
Validation auc = 0.673546
Epoch 8825
Loss = 7.1199e-02, PNorm = 838.8883, GNorm = 1.0214, lr_0 = 9.9380e-04
Validation auc = 0.676625
Epoch 8826
Loss = 1.1250e-01, PNorm = 838.9239, GNorm = 1.8262, lr_0 = 9.9380e-04
Validation auc = 0.676853
Epoch 8827
Loss = 3.5066e-02, PNorm = 838.9669, GNorm = 1.6238, lr_0 = 9.9379e-04
Validation auc = 0.674968
Epoch 8828
Loss = 1.5338e-02, PNorm = 839.0088, GNorm = 0.9853, lr_0 = 9.9379e-04
Validation auc = 0.676544
Epoch 8829
Loss = 5.6584e-02, PNorm = 839.0474, GNorm = 1.5695, lr_0 = 9.9379e-04
Loss = 3.0306e-02, PNorm = 839.0832, GNorm = 1.6668, lr_0 = 9.9379e-04
Validation auc = 0.680933
Epoch 8830
Loss = 3.5722e-02, PNorm = 839.1117, GNorm = 0.5747, lr_0 = 9.9379e-04
Validation auc = 0.682263
Epoch 8831
Loss = 2.3842e-02, PNorm = 839.1351, GNorm = 1.8169, lr_0 = 9.9379e-04
Validation auc = 0.688822
Epoch 8832
Loss = 1.2990e-02, PNorm = 839.1574, GNorm = 1.1712, lr_0 = 9.9379e-04
Validation auc = 0.696543
Epoch 8833
Loss = 3.1650e-02, PNorm = 839.1817, GNorm = 2.7600, lr_0 = 9.9379e-04
Validation auc = 0.692524
Epoch 8834
Loss = 9.3859e-02, PNorm = 839.2171, GNorm = 0.7463, lr_0 = 9.9379e-04
Validation auc = 0.689215
Epoch 8835
Loss = 3.5149e-02, PNorm = 839.2657, GNorm = 2.1400, lr_0 = 9.9379e-04
Validation auc = 0.691613
Epoch 8836
Loss = 3.0256e-02, PNorm = 839.3049, GNorm = 1.6879, lr_0 = 9.9379e-04
Validation auc = 0.689418
Epoch 8837
Loss = 1.2110e-02, PNorm = 839.3367, GNorm = 0.8289, lr_0 = 9.9379e-04
Validation auc = 0.684490
Epoch 8838
Loss = 2.0959e-02, PNorm = 839.3664, GNorm = 1.5793, lr_0 = 9.9379e-04
Validation auc = 0.681204
Epoch 8839
Loss = 1.2899e-02, PNorm = 839.3940, GNorm = 0.9578, lr_0 = 9.9379e-04
Loss = 4.1185e-02, PNorm = 839.4198, GNorm = 0.6618, lr_0 = 9.9378e-04
Validation auc = 0.674909
Epoch 8840
Loss = 4.4352e-02, PNorm = 839.4502, GNorm = 1.8514, lr_0 = 9.9378e-04
Validation auc = 0.668362
Epoch 8841
Loss = 2.3695e-02, PNorm = 839.4824, GNorm = 0.4946, lr_0 = 9.9378e-04
Validation auc = 0.662569
Epoch 8842
Loss = 1.9836e-02, PNorm = 839.5088, GNorm = 1.7038, lr_0 = 9.9378e-04
Validation auc = 0.667714
Epoch 8843
Loss = 6.9577e-02, PNorm = 839.5322, GNorm = 0.8530, lr_0 = 9.9378e-04
Validation auc = 0.675604
Epoch 8844
Loss = 2.3769e-02, PNorm = 839.5584, GNorm = 2.0894, lr_0 = 9.9378e-04
Validation auc = 0.683674
Epoch 8845
Loss = 2.7598e-02, PNorm = 839.5820, GNorm = 0.6154, lr_0 = 9.9378e-04
Validation auc = 0.688836
Epoch 8846
Loss = 2.7265e-02, PNorm = 839.6082, GNorm = 0.7867, lr_0 = 9.9378e-04
Validation auc = 0.686572
Epoch 8847
Loss = 1.4424e-02, PNorm = 839.6365, GNorm = 0.6130, lr_0 = 9.9378e-04
Validation auc = 0.680449
Epoch 8848
Loss = 1.4703e-02, PNorm = 839.6594, GNorm = 2.8453, lr_0 = 9.9378e-04
Validation auc = 0.679945
Epoch 8849
Loss = 5.3778e-03, PNorm = 839.6855, GNorm = 0.3496, lr_0 = 9.9378e-04
Loss = 2.5981e-02, PNorm = 839.7354, GNorm = 1.3724, lr_0 = 9.9378e-04
Validation auc = 0.681107
Epoch 8850
Loss = 3.5747e-02, PNorm = 839.7803, GNorm = 0.7485, lr_0 = 9.9378e-04
Validation auc = 0.676681
Epoch 8851
Loss = 4.4031e-02, PNorm = 839.8186, GNorm = 0.8049, lr_0 = 9.9378e-04
Validation auc = 0.674945
Epoch 8852
Loss = 4.1562e-02, PNorm = 839.8521, GNorm = 1.7842, lr_0 = 9.9378e-04
Validation auc = 0.672418
Epoch 8853
Loss = 3.1676e-02, PNorm = 839.8815, GNorm = 1.7368, lr_0 = 9.9377e-04
Validation auc = 0.672836
Epoch 8854
Loss = 2.5558e-02, PNorm = 839.9074, GNorm = 0.2277, lr_0 = 9.9377e-04
Validation auc = 0.673063
Epoch 8855
Loss = 4.3021e-02, PNorm = 839.9314, GNorm = 4.0624, lr_0 = 9.9377e-04
Validation auc = 0.673860
Epoch 8856
Loss = 3.6342e-02, PNorm = 839.9556, GNorm = 0.4998, lr_0 = 9.9377e-04
Validation auc = 0.674939
Epoch 8857
Loss = 7.8347e-03, PNorm = 839.9808, GNorm = 0.9667, lr_0 = 9.9377e-04
Validation auc = 0.676869
Epoch 8858
Loss = 4.1439e-02, PNorm = 840.0054, GNorm = 1.3596, lr_0 = 9.9377e-04
Validation auc = 0.684034
Epoch 8859
Loss = 1.7573e-02, PNorm = 840.0343, GNorm = 1.7758, lr_0 = 9.9377e-04
Loss = 3.3416e-02, PNorm = 840.0639, GNorm = 0.0847, lr_0 = 9.9377e-04
Validation auc = 0.683077
Epoch 8860
Loss = 1.7098e-02, PNorm = 840.0888, GNorm = 0.2743, lr_0 = 9.9377e-04
Validation auc = 0.680826
Epoch 8861
Loss = 3.1037e-02, PNorm = 840.1116, GNorm = 0.3798, lr_0 = 9.9377e-04
Validation auc = 0.676480
Epoch 8862
Loss = 1.2508e-02, PNorm = 840.1346, GNorm = 0.0794, lr_0 = 9.9377e-04
Validation auc = 0.675481
Epoch 8863
Loss = 3.3914e-02, PNorm = 840.1573, GNorm = 1.0216, lr_0 = 9.9377e-04
Validation auc = 0.675252
Epoch 8864
Loss = 1.5897e-02, PNorm = 840.1817, GNorm = 0.9662, lr_0 = 9.9377e-04
Validation auc = 0.673477
Epoch 8865
Loss = 3.4238e-02, PNorm = 840.2022, GNorm = 0.8410, lr_0 = 9.9377e-04
Validation auc = 0.671619
Epoch 8866
Loss = 1.5943e-02, PNorm = 840.2266, GNorm = 0.5044, lr_0 = 9.9377e-04
Validation auc = 0.668210
Epoch 8867
Loss = 3.8480e-02, PNorm = 840.2502, GNorm = 2.1584, lr_0 = 9.9376e-04
Validation auc = 0.667186
Epoch 8868
Loss = 1.2352e-01, PNorm = 840.2853, GNorm = 9.6695, lr_0 = 9.9376e-04
Validation auc = 0.658373
Epoch 8869
Loss = 1.0408e-01, PNorm = 840.3288, GNorm = 2.8519, lr_0 = 9.9376e-04
Loss = 2.4613e-02, PNorm = 840.3682, GNorm = 0.5654, lr_0 = 9.9376e-04
Validation auc = 0.659067
Epoch 8870
Loss = 5.7318e-02, PNorm = 840.3996, GNorm = 2.0668, lr_0 = 9.9376e-04
Validation auc = 0.657703
Epoch 8871
Loss = 3.6375e-02, PNorm = 840.4317, GNorm = 0.5492, lr_0 = 9.9376e-04
Validation auc = 0.664069
Epoch 8872
Loss = 2.5330e-02, PNorm = 840.4704, GNorm = 2.6278, lr_0 = 9.9376e-04
Validation auc = 0.666734
Epoch 8873
Loss = 6.9539e-02, PNorm = 840.5054, GNorm = 3.6178, lr_0 = 9.9376e-04
Validation auc = 0.661881
Epoch 8874
Loss = 3.1947e-02, PNorm = 840.5425, GNorm = 2.7504, lr_0 = 9.9376e-04
Validation auc = 0.660801
Epoch 8875
Loss = 6.7720e-02, PNorm = 840.5726, GNorm = 1.4520, lr_0 = 9.9376e-04
Validation auc = 0.660808
Epoch 8876
Loss = 1.3613e-01, PNorm = 840.6111, GNorm = 8.2125, lr_0 = 9.9376e-04
Validation auc = 0.668937
Epoch 8877
Loss = 2.6313e-02, PNorm = 840.6524, GNorm = 1.1267, lr_0 = 9.9376e-04
Validation auc = 0.677505
Epoch 8878
Loss = 3.7737e-02, PNorm = 840.6908, GNorm = 2.3563, lr_0 = 9.9376e-04
Validation auc = 0.681840
Epoch 8879
Loss = 1.4920e-02, PNorm = 840.7336, GNorm = 0.5967, lr_0 = 9.9376e-04
Loss = 4.3208e-02, PNorm = 840.7713, GNorm = 3.1999, lr_0 = 9.9375e-04
Validation auc = 0.684036
Epoch 8880
Loss = 1.9625e-01, PNorm = 840.8402, GNorm = 1.8893, lr_0 = 9.9375e-04
Validation auc = 0.672274
Epoch 8881
Loss = 2.7770e-02, PNorm = 840.9209, GNorm = 1.2896, lr_0 = 9.9375e-04
Validation auc = 0.667399
Epoch 8882
Loss = 7.0474e-01, PNorm = 840.9891, GNorm = 17.9427, lr_0 = 9.9375e-04
Validation auc = 0.671267
Epoch 8883
Loss = 6.9666e-02, PNorm = 841.0937, GNorm = 2.0566, lr_0 = 9.9375e-04
Validation auc = 0.673280
Epoch 8884
Loss = 5.7123e-02, PNorm = 841.1667, GNorm = 0.2991, lr_0 = 9.9375e-04
Validation auc = 0.672634
Epoch 8885
Loss = 9.0099e-02, PNorm = 841.2213, GNorm = 5.2545, lr_0 = 9.9375e-04
Validation auc = 0.669557
Epoch 8886
Loss = 3.1747e-02, PNorm = 841.2821, GNorm = 0.2839, lr_0 = 9.9375e-04
Validation auc = 0.669456
Epoch 8887
Loss = 9.0288e-02, PNorm = 841.3458, GNorm = 0.5146, lr_0 = 9.9375e-04
Validation auc = 0.668001
Epoch 8888
Loss = 3.5142e-02, PNorm = 841.4128, GNorm = 0.4240, lr_0 = 9.9375e-04
Validation auc = 0.662529
Epoch 8889
Loss = 1.0541e-01, PNorm = 841.4715, GNorm = 1.9500, lr_0 = 9.9375e-04
Loss = 5.1785e-02, PNorm = 841.5323, GNorm = 1.0841, lr_0 = 9.9375e-04
Validation auc = 0.659016
Epoch 8890
Loss = 5.9230e-02, PNorm = 841.5820, GNorm = 0.5132, lr_0 = 9.9375e-04
Validation auc = 0.661547
Epoch 8891
Loss = 1.6776e-01, PNorm = 841.6430, GNorm = 3.6495, lr_0 = 9.9375e-04
Validation auc = 0.681488
Epoch 8892
Loss = 4.3038e-02, PNorm = 841.7097, GNorm = 2.7532, lr_0 = 9.9375e-04
Validation auc = 0.683223
Epoch 8893
Loss = 7.6767e-02, PNorm = 841.7603, GNorm = 3.2087, lr_0 = 9.9374e-04
Validation auc = 0.685038
Epoch 8894
Loss = 8.8716e-02, PNorm = 841.8033, GNorm = 0.2774, lr_0 = 9.9374e-04
Validation auc = 0.684933
Epoch 8895
Loss = 4.5232e-02, PNorm = 841.8470, GNorm = 3.3175, lr_0 = 9.9374e-04
Validation auc = 0.683539
Epoch 8896
Loss = 1.2024e-02, PNorm = 841.8824, GNorm = 1.0425, lr_0 = 9.9374e-04
Validation auc = 0.683620
Epoch 8897
Loss = 1.6229e-02, PNorm = 841.9101, GNorm = 0.7564, lr_0 = 9.9374e-04
Validation auc = 0.683760
Epoch 8898
Loss = 1.2601e-02, PNorm = 841.9398, GNorm = 0.8926, lr_0 = 9.9374e-04
Validation auc = 0.685042
Epoch 8899
Loss = 4.9132e-02, PNorm = 841.9705, GNorm = 1.5450, lr_0 = 9.9374e-04
Loss = 1.0958e-01, PNorm = 842.0173, GNorm = 6.0701, lr_0 = 9.9374e-04
Validation auc = 0.671647
Epoch 8900
Loss = 5.4341e-02, PNorm = 842.0900, GNorm = 1.4614, lr_0 = 9.9374e-04
Validation auc = 0.658526
Epoch 8901
Loss = 6.6580e-02, PNorm = 842.1500, GNorm = 2.7084, lr_0 = 9.9374e-04
Validation auc = 0.659663
Epoch 8902
Loss = 1.1071e-01, PNorm = 842.2164, GNorm = 3.8117, lr_0 = 9.9374e-04
Validation auc = 0.684300
Epoch 8903
Loss = 4.9965e-02, PNorm = 842.2871, GNorm = 7.4852, lr_0 = 9.9374e-04
Validation auc = 0.693104
Epoch 8904
Loss = 9.8446e-02, PNorm = 842.3542, GNorm = 16.4892, lr_0 = 9.9374e-04
Validation auc = 0.684451
Epoch 8905
Loss = 4.7094e-02, PNorm = 842.4779, GNorm = 4.8436, lr_0 = 9.9374e-04
Validation auc = 0.694590
Epoch 8906
Loss = 3.9434e-02, PNorm = 842.5673, GNorm = 3.0059, lr_0 = 9.9373e-04
Validation auc = 0.696423
Epoch 8907
Loss = 5.5807e-02, PNorm = 842.6288, GNorm = 0.6580, lr_0 = 9.9373e-04
Validation auc = 0.692381
Epoch 8908
Loss = 9.1503e-02, PNorm = 842.6862, GNorm = 3.4212, lr_0 = 9.9373e-04
Validation auc = 0.692501
Epoch 8909
Loss = 6.3186e-03, PNorm = 842.7368, GNorm = 0.3132, lr_0 = 9.9373e-04
Loss = 7.3966e-02, PNorm = 842.7825, GNorm = 3.3995, lr_0 = 9.9373e-04
Validation auc = 0.682230
Epoch 8910
Loss = 3.0061e-02, PNorm = 842.8276, GNorm = 0.4970, lr_0 = 9.9373e-04
Validation auc = 0.679560
Epoch 8911
Loss = 3.1100e-02, PNorm = 842.8632, GNorm = 1.1212, lr_0 = 9.9373e-04
Validation auc = 0.680974
Epoch 8912
Loss = 9.8274e-02, PNorm = 842.8963, GNorm = 6.8491, lr_0 = 9.9373e-04
Validation auc = 0.677696
Epoch 8913
Loss = 3.3984e-02, PNorm = 842.9388, GNorm = 0.8061, lr_0 = 9.9373e-04
Validation auc = 0.676602
Epoch 8914
Loss = 1.0631e-01, PNorm = 842.9829, GNorm = 2.0696, lr_0 = 9.9373e-04
Validation auc = 0.673043
Epoch 8915
Loss = 1.1361e-01, PNorm = 843.0281, GNorm = 1.3712, lr_0 = 9.9373e-04
Validation auc = 0.671622
Epoch 8916
Loss = 6.9441e-02, PNorm = 843.0702, GNorm = 1.3854, lr_0 = 9.9373e-04
Validation auc = 0.670995
Epoch 8917
Loss = 3.0910e-02, PNorm = 843.0999, GNorm = 1.8928, lr_0 = 9.9373e-04
Validation auc = 0.673426
Epoch 8918
Loss = 5.0684e-02, PNorm = 843.1224, GNorm = 0.5266, lr_0 = 9.9373e-04
Validation auc = 0.677135
Epoch 8919
Loss = 4.9846e-02, PNorm = 843.1473, GNorm = 3.3061, lr_0 = 9.9373e-04
Loss = 3.4505e-02, PNorm = 843.1734, GNorm = 0.1326, lr_0 = 9.9372e-04
Validation auc = 0.677427
Epoch 8920
Loss = 2.9987e-02, PNorm = 843.1999, GNorm = 0.4120, lr_0 = 9.9372e-04
Validation auc = 0.681134
Epoch 8921
Loss = 4.4847e-02, PNorm = 843.2336, GNorm = 0.4720, lr_0 = 9.9372e-04
Validation auc = 0.677844
Epoch 8922
Loss = 3.8659e-02, PNorm = 843.2664, GNorm = 2.0820, lr_0 = 9.9372e-04
Validation auc = 0.675503
Epoch 8923
Loss = 6.1456e-02, PNorm = 843.3033, GNorm = 0.5827, lr_0 = 9.9372e-04
Validation auc = 0.682799
Epoch 8924
Loss = 4.4398e-02, PNorm = 843.3610, GNorm = 0.4047, lr_0 = 9.9372e-04
Validation auc = 0.695270
Epoch 8925
Loss = 4.9258e-02, PNorm = 843.4209, GNorm = 3.7054, lr_0 = 9.9372e-04
Validation auc = 0.697367
Epoch 8926
Loss = 8.4873e-02, PNorm = 843.4787, GNorm = 2.5668, lr_0 = 9.9372e-04
Validation auc = 0.696606
Epoch 8927
Loss = 4.8798e-02, PNorm = 843.5329, GNorm = 1.3764, lr_0 = 9.9372e-04
Validation auc = 0.699885
Epoch 8928
Loss = 2.3133e-02, PNorm = 843.5773, GNorm = 0.7152, lr_0 = 9.9372e-04
Validation auc = 0.709517
Epoch 8929
Loss = 3.9953e-02, PNorm = 843.6236, GNorm = 3.0233, lr_0 = 9.9372e-04
Loss = 3.7830e-02, PNorm = 843.6669, GNorm = 0.4040, lr_0 = 9.9372e-04
Validation auc = 0.708393
Epoch 8930
Loss = 4.9088e-02, PNorm = 843.7066, GNorm = 0.6015, lr_0 = 9.9372e-04
Validation auc = 0.707763
Epoch 8931
Loss = 3.8890e-02, PNorm = 843.7411, GNorm = 0.2653, lr_0 = 9.9372e-04
Validation auc = 0.703433
Epoch 8932
Loss = 6.2060e-02, PNorm = 843.7731, GNorm = 1.1004, lr_0 = 9.9372e-04
Validation auc = 0.695715
Epoch 8933
Loss = 1.1562e-01, PNorm = 843.8050, GNorm = 0.6856, lr_0 = 9.9371e-04
Validation auc = 0.688216
Epoch 8934
Loss = 4.4996e-02, PNorm = 843.8415, GNorm = 0.3780, lr_0 = 9.9371e-04
Validation auc = 0.689348
Epoch 8935
Loss = 7.3724e-02, PNorm = 843.8828, GNorm = 1.7018, lr_0 = 9.9371e-04
Validation auc = 0.686772
Epoch 8936
Loss = 3.1077e-02, PNorm = 843.9225, GNorm = 1.7572, lr_0 = 9.9371e-04
Validation auc = 0.689812
Epoch 8937
Loss = 1.5852e-02, PNorm = 843.9591, GNorm = 0.6455, lr_0 = 9.9371e-04
Validation auc = 0.693932
Epoch 8938
Loss = 2.8960e-02, PNorm = 843.9925, GNorm = 2.5694, lr_0 = 9.9371e-04
Validation auc = 0.680687
Epoch 8939
Loss = 4.1758e-02, PNorm = 844.0564, GNorm = 3.3763, lr_0 = 9.9371e-04
Loss = 2.0054e-01, PNorm = 844.1816, GNorm = 2.1711, lr_0 = 9.9371e-04
Validation auc = 0.657677
Epoch 8940
Loss = 1.1420e-01, PNorm = 844.3078, GNorm = 3.0512, lr_0 = 9.9371e-04
Validation auc = 0.656954
Epoch 8941
Loss = 1.0457e-01, PNorm = 844.4072, GNorm = 7.4419, lr_0 = 9.9371e-04
Validation auc = 0.657154
Epoch 8942
Loss = 1.1409e-01, PNorm = 844.4893, GNorm = 11.1472, lr_0 = 9.9371e-04
Validation auc = 0.660250
Epoch 8943
Loss = 7.3624e-02, PNorm = 844.5543, GNorm = 4.3322, lr_0 = 9.9371e-04
Validation auc = 0.673791
Epoch 8944
Loss = 2.0882e-01, PNorm = 844.6131, GNorm = 15.9725, lr_0 = 9.9371e-04
Validation auc = 0.681309
Epoch 8945
Loss = 3.4526e-02, PNorm = 844.6702, GNorm = 5.5170, lr_0 = 9.9371e-04
Validation auc = 0.682215
Epoch 8946
Loss = 2.7090e-02, PNorm = 844.7144, GNorm = 0.7189, lr_0 = 9.9370e-04
Validation auc = 0.683051
Epoch 8947
Loss = 5.5822e-02, PNorm = 844.7483, GNorm = 5.4294, lr_0 = 9.9370e-04
Validation auc = 0.683888
Epoch 8948
Loss = 5.1031e-02, PNorm = 844.7793, GNorm = 4.1624, lr_0 = 9.9370e-04
Validation auc = 0.680844
Epoch 8949
Loss = 2.5718e-02, PNorm = 844.8142, GNorm = 1.4651, lr_0 = 9.9370e-04
Loss = 5.1824e-02, PNorm = 844.8501, GNorm = 0.6179, lr_0 = 9.9370e-04
Validation auc = 0.678317
Epoch 8950
Loss = 3.1368e-01, PNorm = 844.9288, GNorm = 3.3322, lr_0 = 9.9370e-04
Validation auc = 0.672407
Epoch 8951
Loss = 9.2118e-02, PNorm = 845.0288, GNorm = 4.6033, lr_0 = 9.9370e-04
Validation auc = 0.667119
Epoch 8952
Loss = 8.1152e-02, PNorm = 845.1204, GNorm = 7.6395, lr_0 = 9.9370e-04
Validation auc = 0.678643
Epoch 8953
Loss = 5.8076e-02, PNorm = 845.2062, GNorm = 1.0743, lr_0 = 9.9370e-04
Validation auc = 0.691703
Epoch 8954
Loss = 9.1132e-02, PNorm = 845.2660, GNorm = 2.5274, lr_0 = 9.9370e-04
Validation auc = 0.692558
Epoch 8955
Loss = 3.0034e-02, PNorm = 845.3288, GNorm = 2.3615, lr_0 = 9.9370e-04
Validation auc = 0.687829
Epoch 8956
Loss = 1.0225e-01, PNorm = 845.3814, GNorm = 1.3345, lr_0 = 9.9370e-04
Validation auc = 0.678699
Epoch 8957
Loss = 1.5026e-01, PNorm = 845.4254, GNorm = 0.3105, lr_0 = 9.9370e-04
Validation auc = 0.675511
Epoch 8958
Loss = 5.1210e-02, PNorm = 845.5002, GNorm = 1.1285, lr_0 = 9.9370e-04
Validation auc = 0.686331
Epoch 8959
Loss = 3.8024e-02, PNorm = 845.5773, GNorm = 1.2068, lr_0 = 9.9370e-04
Loss = 7.4925e-02, PNorm = 845.6298, GNorm = 0.8122, lr_0 = 9.9369e-04
Validation auc = 0.690928
Epoch 8960
Loss = 6.8616e-02, PNorm = 845.6650, GNorm = 0.4931, lr_0 = 9.9369e-04
Validation auc = 0.692398
Epoch 8961
Loss = 7.7698e-02, PNorm = 845.6915, GNorm = 0.9760, lr_0 = 9.9369e-04
Validation auc = 0.693842
Epoch 8962
Loss = 3.1837e-02, PNorm = 845.7210, GNorm = 0.8663, lr_0 = 9.9369e-04
Validation auc = 0.690908
Epoch 8963
Loss = 1.2162e-01, PNorm = 845.7493, GNorm = 0.6463, lr_0 = 9.9369e-04
Validation auc = 0.687426
Epoch 8964
Loss = 1.1490e-01, PNorm = 845.7887, GNorm = 0.5780, lr_0 = 9.9369e-04
Validation auc = 0.685248
Epoch 8965
Loss = 7.1144e-02, PNorm = 845.8417, GNorm = 4.4390, lr_0 = 9.9369e-04
Validation auc = 0.686087
Epoch 8966
Loss = 1.2687e-01, PNorm = 845.8975, GNorm = 2.3448, lr_0 = 9.9369e-04
Validation auc = 0.688598
Epoch 8967
Loss = 7.4794e-02, PNorm = 845.9423, GNorm = 0.4922, lr_0 = 9.9369e-04
Validation auc = 0.691558
Epoch 8968
Loss = 8.2864e-02, PNorm = 845.9796, GNorm = 7.5288, lr_0 = 9.9369e-04
Validation auc = 0.691400
Epoch 8969
Loss = 8.6562e-02, PNorm = 846.0187, GNorm = 6.9859, lr_0 = 9.9369e-04
Loss = 4.1330e-02, PNorm = 846.0538, GNorm = 0.4429, lr_0 = 9.9369e-04
Validation auc = 0.687850
Epoch 8970
Loss = 7.8400e-02, PNorm = 846.0869, GNorm = 19.3386, lr_0 = 9.9369e-04
Validation auc = 0.686351
Epoch 8971
Loss = 2.8075e-02, PNorm = 846.1220, GNorm = 1.0964, lr_0 = 9.9369e-04
Validation auc = 0.688133
Epoch 8972
Loss = 5.8048e-02, PNorm = 846.1540, GNorm = 0.2284, lr_0 = 9.9369e-04
Validation auc = 0.685875
Epoch 8973
Loss = 9.8973e-02, PNorm = 846.1905, GNorm = 1.1359, lr_0 = 9.9368e-04
Validation auc = 0.680258
Epoch 8974
Loss = 1.7932e-02, PNorm = 846.2346, GNorm = 0.3444, lr_0 = 9.9368e-04
Validation auc = 0.681328
Epoch 8975
Loss = 3.2220e-02, PNorm = 846.2702, GNorm = 1.0315, lr_0 = 9.9368e-04
Validation auc = 0.680230
Epoch 8976
Loss = 9.9409e-02, PNorm = 846.3014, GNorm = 1.1523, lr_0 = 9.9368e-04
Validation auc = 0.672214
Epoch 8977
Loss = 4.9841e-02, PNorm = 846.3396, GNorm = 4.4735, lr_0 = 9.9368e-04
Validation auc = 0.680972
Epoch 8978
Loss = 1.3231e-01, PNorm = 846.3878, GNorm = 0.5987, lr_0 = 9.9368e-04
Validation auc = 0.691348
Epoch 8979
Loss = 5.5971e-02, PNorm = 846.4389, GNorm = 0.9264, lr_0 = 9.9368e-04
Loss = 3.6774e-02, PNorm = 846.4740, GNorm = 4.6789, lr_0 = 9.9368e-04
Validation auc = 0.697165
Epoch 8980
Loss = 3.3464e-02, PNorm = 846.5022, GNorm = 0.2849, lr_0 = 9.9368e-04
Validation auc = 0.688964
Epoch 8981
Loss = 3.3048e-02, PNorm = 846.5299, GNorm = 1.8464, lr_0 = 9.9368e-04
Validation auc = 0.686487
Epoch 8982
Loss = 3.0933e-02, PNorm = 846.5605, GNorm = 0.8679, lr_0 = 9.9368e-04
Validation auc = 0.683807
Epoch 8983
Loss = 4.3278e-02, PNorm = 846.5898, GNorm = 2.6581, lr_0 = 9.9368e-04
Validation auc = 0.682083
Epoch 8984
Loss = 1.2000e-01, PNorm = 846.6211, GNorm = 2.0637, lr_0 = 9.9368e-04
Validation auc = 0.682641
Epoch 8985
Loss = 1.9101e-02, PNorm = 846.6508, GNorm = 1.5620, lr_0 = 9.9368e-04
Validation auc = 0.686367
Epoch 8986
Loss = 4.2190e-02, PNorm = 846.6746, GNorm = 2.1342, lr_0 = 9.9367e-04
Validation auc = 0.689200
Epoch 8987
Loss = 3.6639e-02, PNorm = 846.7032, GNorm = 2.1590, lr_0 = 9.9367e-04
Validation auc = 0.687788
Epoch 8988
Loss = 2.4000e-02, PNorm = 846.7336, GNorm = 1.5161, lr_0 = 9.9367e-04
Validation auc = 0.691526
Epoch 8989
Loss = 2.0218e-03, PNorm = 846.7611, GNorm = 0.1781, lr_0 = 9.9367e-04
Loss = 3.1588e-02, PNorm = 846.7843, GNorm = 5.5944, lr_0 = 9.9367e-04
Validation auc = 0.693625
Epoch 8990
Loss = 2.6882e-02, PNorm = 846.8053, GNorm = 3.1150, lr_0 = 9.9367e-04
Validation auc = 0.696019
Epoch 8991
Loss = 2.4703e-02, PNorm = 846.8374, GNorm = 0.9153, lr_0 = 9.9367e-04
Validation auc = 0.701736
Epoch 8992
Loss = 2.7874e-02, PNorm = 846.8628, GNorm = 3.4197, lr_0 = 9.9367e-04
Validation auc = 0.704014
Epoch 8993
Loss = 3.3684e-02, PNorm = 846.8822, GNorm = 0.8957, lr_0 = 9.9367e-04
Validation auc = 0.704861
Epoch 8994
Loss = 5.7310e-02, PNorm = 846.9040, GNorm = 2.5084, lr_0 = 9.9367e-04
Validation auc = 0.703637
Epoch 8995
Loss = 3.1609e-02, PNorm = 846.9271, GNorm = 2.2773, lr_0 = 9.9367e-04
Validation auc = 0.701423
Epoch 8996
Loss = 2.7544e-02, PNorm = 846.9489, GNorm = 0.6571, lr_0 = 9.9367e-04
Validation auc = 0.699918
Epoch 8997
Loss = 2.2510e-02, PNorm = 847.0019, GNorm = 0.3140, lr_0 = 9.9367e-04
Validation auc = 0.691859
Epoch 8998
Loss = 3.2874e-02, PNorm = 847.0557, GNorm = 2.1439, lr_0 = 9.9367e-04
Validation auc = 0.693206
Epoch 8999
Loss = 9.8702e-03, PNorm = 847.0948, GNorm = 0.8847, lr_0 = 9.9367e-04
Loss = 2.3012e-02, PNorm = 847.1244, GNorm = 0.5872, lr_0 = 9.9366e-04
Validation auc = 0.697309
Epoch 9000
Loss = 3.8780e-02, PNorm = 847.1586, GNorm = 1.3561, lr_0 = 9.9366e-04
Validation auc = 0.696287
Epoch 9001
Loss = 2.2124e-02, PNorm = 847.1877, GNorm = 0.7654, lr_0 = 9.9366e-04
Validation auc = 0.696923
Epoch 9002
Loss = 4.3675e-02, PNorm = 847.2111, GNorm = 1.5387, lr_0 = 9.9366e-04
Validation auc = 0.693155
Epoch 9003
Loss = 2.4674e-02, PNorm = 847.2346, GNorm = 0.1764, lr_0 = 9.9366e-04
Validation auc = 0.691260
Epoch 9004
Loss = 5.9001e-02, PNorm = 847.2546, GNorm = 1.1233, lr_0 = 9.9366e-04
Validation auc = 0.693980
Epoch 9005
Loss = 2.5563e-02, PNorm = 847.2794, GNorm = 0.3486, lr_0 = 9.9366e-04
Validation auc = 0.694920
Epoch 9006
Loss = 2.5269e-02, PNorm = 847.3072, GNorm = 3.0070, lr_0 = 9.9366e-04
Validation auc = 0.693180
Epoch 9007
Loss = 2.2503e-02, PNorm = 847.3387, GNorm = 2.4004, lr_0 = 9.9366e-04
Validation auc = 0.689426
Epoch 9008
Loss = 6.8570e-02, PNorm = 847.3662, GNorm = 3.3114, lr_0 = 9.9366e-04
Validation auc = 0.687477
Epoch 9009
Loss = 1.0924e-01, PNorm = 847.3880, GNorm = 2.6572, lr_0 = 9.9366e-04
Loss = 2.9717e-02, PNorm = 847.4063, GNorm = 0.2567, lr_0 = 9.9366e-04
Validation auc = 0.689541
Epoch 9010
Loss = 6.4735e-02, PNorm = 847.4223, GNorm = 0.2353, lr_0 = 9.9366e-04
Validation auc = 0.687178
Epoch 9011
Loss = 2.1708e-02, PNorm = 847.4418, GNorm = 1.5603, lr_0 = 9.9366e-04
Validation auc = 0.685922
Epoch 9012
Loss = 3.7320e-02, PNorm = 847.4644, GNorm = 4.9322, lr_0 = 9.9365e-04
Validation auc = 0.681526
Epoch 9013
Loss = 5.6591e-02, PNorm = 847.4867, GNorm = 0.2548, lr_0 = 9.9365e-04
Validation auc = 0.683817
Epoch 9014
Loss = 1.8685e-02, PNorm = 847.5094, GNorm = 2.7550, lr_0 = 9.9365e-04
Validation auc = 0.684369
Epoch 9015
Loss = 2.3438e-02, PNorm = 847.5318, GNorm = 2.1679, lr_0 = 9.9365e-04
Validation auc = 0.685235
Epoch 9016
Loss = 1.4400e-02, PNorm = 847.5553, GNorm = 0.3312, lr_0 = 9.9365e-04
Validation auc = 0.685805
Epoch 9017
Loss = 1.4152e-02, PNorm = 847.5748, GNorm = 0.2000, lr_0 = 9.9365e-04
Validation auc = 0.685477
Epoch 9018
Loss = 3.2269e-02, PNorm = 847.5967, GNorm = 1.0958, lr_0 = 9.9365e-04
Validation auc = 0.686178
Epoch 9019
Loss = 1.1367e-01, PNorm = 847.6214, GNorm = 5.6735, lr_0 = 9.9365e-04
Loss = 1.3802e-02, PNorm = 847.6506, GNorm = 0.2100, lr_0 = 9.9365e-04
Validation auc = 0.686245
Epoch 9020
Loss = 3.2641e-02, PNorm = 847.6749, GNorm = 0.8150, lr_0 = 9.9365e-04
Validation auc = 0.687955
Epoch 9021
Loss = 5.3149e-02, PNorm = 847.7068, GNorm = 0.6778, lr_0 = 9.9365e-04
Validation auc = 0.687002
Epoch 9022
Loss = 5.1578e-02, PNorm = 847.7362, GNorm = 0.4811, lr_0 = 9.9365e-04
Validation auc = 0.691227
Epoch 9023
Loss = 3.5263e-02, PNorm = 847.7654, GNorm = 1.2744, lr_0 = 9.9365e-04
Validation auc = 0.689680
Epoch 9024
Loss = 4.2027e-02, PNorm = 847.7961, GNorm = 3.6631, lr_0 = 9.9365e-04
Validation auc = 0.690960
Epoch 9025
Loss = 2.5623e-02, PNorm = 847.8282, GNorm = 2.9615, lr_0 = 9.9365e-04
Validation auc = 0.691706
Epoch 9026
Loss = 3.1536e-02, PNorm = 847.8648, GNorm = 0.2921, lr_0 = 9.9364e-04
Validation auc = 0.690223
Epoch 9027
Loss = 1.1651e-02, PNorm = 847.8946, GNorm = 0.5022, lr_0 = 9.9364e-04
Validation auc = 0.690685
Epoch 9028
Loss = 5.9378e-03, PNorm = 847.9198, GNorm = 0.2195, lr_0 = 9.9364e-04
Validation auc = 0.691845
Epoch 9029
Loss = 1.4816e-02, PNorm = 847.9474, GNorm = 0.8349, lr_0 = 9.9364e-04
Loss = 1.8642e-02, PNorm = 847.9786, GNorm = 0.5872, lr_0 = 9.9364e-04
Validation auc = 0.695401
Epoch 9030
Loss = 7.0578e-02, PNorm = 848.0067, GNorm = 4.9025, lr_0 = 9.9364e-04
Validation auc = 0.698293
Epoch 9031
Loss = 2.4536e-02, PNorm = 848.0458, GNorm = 1.0242, lr_0 = 9.9364e-04
Validation auc = 0.695980
Epoch 9032
Loss = 3.2475e-02, PNorm = 848.0799, GNorm = 0.2073, lr_0 = 9.9364e-04
Validation auc = 0.695169
Epoch 9033
Loss = 1.9375e-02, PNorm = 848.1138, GNorm = 1.5209, lr_0 = 9.9364e-04
Validation auc = 0.691199
Epoch 9034
Loss = 1.1075e-02, PNorm = 848.1505, GNorm = 0.4957, lr_0 = 9.9364e-04
Validation auc = 0.692917
Epoch 9035
Loss = 1.6727e-02, PNorm = 848.1813, GNorm = 0.2677, lr_0 = 9.9364e-04
Validation auc = 0.696425
Epoch 9036
Loss = 2.1521e-01, PNorm = 848.2183, GNorm = 11.8539, lr_0 = 9.9364e-04
Validation auc = 0.695932
Epoch 9037
Loss = 2.5543e-02, PNorm = 848.2739, GNorm = 0.3705, lr_0 = 9.9364e-04
Validation auc = 0.690518
Epoch 9038
Loss = 1.4969e-01, PNorm = 848.3188, GNorm = 0.9960, lr_0 = 9.9364e-04
Validation auc = 0.679596
Epoch 9039
Loss = 7.1941e-03, PNorm = 848.3613, GNorm = 0.3369, lr_0 = 9.9364e-04
Loss = 7.3948e-02, PNorm = 848.4049, GNorm = 0.3829, lr_0 = 9.9363e-04
Validation auc = 0.683429
Epoch 9040
Loss = 3.4156e-02, PNorm = 848.4422, GNorm = 0.4755, lr_0 = 9.9363e-04
Validation auc = 0.688819
Epoch 9041
Loss = 1.8029e-01, PNorm = 848.4811, GNorm = 0.9163, lr_0 = 9.9363e-04
Validation auc = 0.694086
Epoch 9042
Loss = 8.3751e-02, PNorm = 848.5291, GNorm = 0.9312, lr_0 = 9.9363e-04
Validation auc = 0.686527
Epoch 9043
Loss = 3.8609e-02, PNorm = 848.5894, GNorm = 1.6993, lr_0 = 9.9363e-04
Validation auc = 0.673719
Epoch 9044
Loss = 8.3491e-02, PNorm = 848.6415, GNorm = 4.3606, lr_0 = 9.9363e-04
Validation auc = 0.667933
Epoch 9045
Loss = 3.4681e-02, PNorm = 848.6933, GNorm = 1.3874, lr_0 = 9.9363e-04
Validation auc = 0.675225
Epoch 9046
Loss = 4.7521e-02, PNorm = 848.7404, GNorm = 3.0297, lr_0 = 9.9363e-04
Validation auc = 0.674292
Epoch 9047
Loss = 2.6616e-02, PNorm = 848.7867, GNorm = 1.1930, lr_0 = 9.9363e-04
Validation auc = 0.672064
Epoch 9048
Loss = 3.1621e-02, PNorm = 848.8235, GNorm = 1.1220, lr_0 = 9.9363e-04
Validation auc = 0.673479
Epoch 9049
Loss = 9.3951e-03, PNorm = 848.8591, GNorm = 0.3933, lr_0 = 9.9363e-04
Loss = 3.5226e-02, PNorm = 848.8909, GNorm = 10.3543, lr_0 = 9.9363e-04
Validation auc = 0.673644
Epoch 9050
Loss = 7.3130e-02, PNorm = 848.9276, GNorm = 2.2915, lr_0 = 9.9363e-04
Validation auc = 0.670606
Epoch 9051
Loss = 2.6286e-02, PNorm = 848.9647, GNorm = 0.4026, lr_0 = 9.9363e-04
Validation auc = 0.671527
Epoch 9052
Loss = 7.0916e-02, PNorm = 848.9953, GNorm = 1.4542, lr_0 = 9.9362e-04
Validation auc = 0.670546
Epoch 9053
Loss = 3.0981e-02, PNorm = 849.0248, GNorm = 0.9611, lr_0 = 9.9362e-04
Validation auc = 0.672853
Epoch 9054
Loss = 6.7733e-02, PNorm = 849.0499, GNorm = 0.2321, lr_0 = 9.9362e-04
Validation auc = 0.675106
Epoch 9055
Loss = 3.8563e-02, PNorm = 849.0814, GNorm = 0.9607, lr_0 = 9.9362e-04
Validation auc = 0.676294
Epoch 9056
Loss = 2.6616e-02, PNorm = 849.1116, GNorm = 1.3048, lr_0 = 9.9362e-04
Validation auc = 0.676852
Epoch 9057
Loss = 1.0095e-01, PNorm = 849.1366, GNorm = 2.8252, lr_0 = 9.9362e-04
Validation auc = 0.678277
Epoch 9058
Loss = 4.5296e-02, PNorm = 849.1654, GNorm = 3.9692, lr_0 = 9.9362e-04
Validation auc = 0.675556
Epoch 9059
Loss = 1.2838e-02, PNorm = 849.1940, GNorm = 0.5697, lr_0 = 9.9362e-04
Loss = 6.8150e-02, PNorm = 849.2316, GNorm = 0.4933, lr_0 = 9.9362e-04
Validation auc = 0.672147
Epoch 9060
Loss = 2.6488e-02, PNorm = 849.2729, GNorm = 0.6148, lr_0 = 9.9362e-04
Validation auc = 0.670668
Epoch 9061
Loss = 3.0446e-02, PNorm = 849.3031, GNorm = 0.1726, lr_0 = 9.9362e-04
Validation auc = 0.665884
Epoch 9062
Loss = 3.1573e-02, PNorm = 849.3313, GNorm = 0.9690, lr_0 = 9.9362e-04
Validation auc = 0.667093
Epoch 9063
Loss = 4.4984e-02, PNorm = 849.3568, GNorm = 1.3776, lr_0 = 9.9362e-04
Validation auc = 0.665013
Epoch 9064
Loss = 1.2770e-02, PNorm = 849.3831, GNorm = 1.8911, lr_0 = 9.9362e-04
Validation auc = 0.666411
Epoch 9065
Loss = 3.2985e-02, PNorm = 849.4067, GNorm = 6.6507, lr_0 = 9.9362e-04
Validation auc = 0.667027
Epoch 9066
Loss = 8.9515e-02, PNorm = 849.4405, GNorm = 1.0510, lr_0 = 9.9361e-04
Validation auc = 0.666147
Epoch 9067
Loss = 1.4963e-02, PNorm = 849.4738, GNorm = 0.9863, lr_0 = 9.9361e-04
Validation auc = 0.668754
Epoch 9068
Loss = 1.4997e-02, PNorm = 849.4958, GNorm = 0.5745, lr_0 = 9.9361e-04
Validation auc = 0.670340
Epoch 9069
Loss = 4.4316e-03, PNorm = 849.5119, GNorm = 0.4481, lr_0 = 9.9361e-04
Loss = 3.2860e-02, PNorm = 849.5253, GNorm = 0.7746, lr_0 = 9.9361e-04
Validation auc = 0.667128
Epoch 9070
Loss = 2.1347e-02, PNorm = 849.5418, GNorm = 1.6444, lr_0 = 9.9361e-04
Validation auc = 0.666038
Epoch 9071
Loss = 1.8628e-02, PNorm = 849.5594, GNorm = 0.2927, lr_0 = 9.9361e-04
Validation auc = 0.663603
Epoch 9072
Loss = 8.1675e-02, PNorm = 849.5780, GNorm = 3.4155, lr_0 = 9.9361e-04
Validation auc = 0.664806
Epoch 9073
Loss = 1.8303e-01, PNorm = 849.6076, GNorm = 11.5411, lr_0 = 9.9361e-04
Validation auc = 0.676709
Epoch 9074
Loss = 5.2360e-02, PNorm = 849.6509, GNorm = 2.0004, lr_0 = 9.9361e-04
Validation auc = 0.684192
Epoch 9075
Loss = 5.1683e-02, PNorm = 849.6915, GNorm = 1.3848, lr_0 = 9.9361e-04
Validation auc = 0.685379
Epoch 9076
Loss = 1.8288e-02, PNorm = 849.7314, GNorm = 1.7521, lr_0 = 9.9361e-04
Validation auc = 0.690603
Epoch 9077
Loss = 2.4671e-01, PNorm = 849.7660, GNorm = 0.3478, lr_0 = 9.9361e-04
Validation auc = 0.691637
Epoch 9078
Loss = 1.3657e-01, PNorm = 849.7926, GNorm = 0.4010, lr_0 = 9.9361e-04
Validation auc = 0.684759
Epoch 9079
Loss = 4.5101e-02, PNorm = 849.8183, GNorm = 3.2907, lr_0 = 9.9360e-04
Loss = 2.5092e-02, PNorm = 849.8408, GNorm = 1.9315, lr_0 = 9.9360e-04
Validation auc = 0.681709
Epoch 9080
Loss = 3.7696e-02, PNorm = 849.8660, GNorm = 3.9565, lr_0 = 9.9360e-04
Validation auc = 0.682989
Epoch 9081
Loss = 1.2414e-02, PNorm = 849.8917, GNorm = 1.2670, lr_0 = 9.9360e-04
Validation auc = 0.680828
Epoch 9082
Loss = 2.6635e-02, PNorm = 849.9228, GNorm = 1.1152, lr_0 = 9.9360e-04
Validation auc = 0.680840
Epoch 9083
Loss = 3.1337e-02, PNorm = 849.9488, GNorm = 0.4045, lr_0 = 9.9360e-04
Validation auc = 0.680600
Epoch 9084
Loss = 2.3234e-02, PNorm = 849.9713, GNorm = 6.4115, lr_0 = 9.9360e-04
Validation auc = 0.673215
Epoch 9085
Loss = 3.3657e-02, PNorm = 849.9975, GNorm = 6.3107, lr_0 = 9.9360e-04
Validation auc = 0.671543
Epoch 9086
Loss = 4.0956e-02, PNorm = 850.0254, GNorm = 3.1859, lr_0 = 9.9360e-04
Validation auc = 0.675732
Epoch 9087
Loss = 5.9438e-02, PNorm = 850.0624, GNorm = 3.5281, lr_0 = 9.9360e-04
Validation auc = 0.680063
Epoch 9088
Loss = 1.1171e-02, PNorm = 850.0995, GNorm = 0.2323, lr_0 = 9.9360e-04
Validation auc = 0.693321
Epoch 9089
Loss = 5.2737e-02, PNorm = 850.1416, GNorm = 2.1315, lr_0 = 9.9360e-04
Loss = 5.5323e-02, PNorm = 850.1762, GNorm = 0.5657, lr_0 = 9.9360e-04
Validation auc = 0.694723
Epoch 9090
Loss = 3.0874e-02, PNorm = 850.2075, GNorm = 2.5569, lr_0 = 9.9360e-04
Validation auc = 0.695883
Epoch 9091
Loss = 3.2547e-02, PNorm = 850.2376, GNorm = 4.4338, lr_0 = 9.9360e-04
Validation auc = 0.697055
Epoch 9092
Loss = 6.2064e-02, PNorm = 850.2761, GNorm = 2.4523, lr_0 = 9.9359e-04
Validation auc = 0.694959
Epoch 9093
Loss = 1.0715e-02, PNorm = 850.3072, GNorm = 1.3570, lr_0 = 9.9359e-04
Validation auc = 0.694211
Epoch 9094
Loss = 6.5192e-02, PNorm = 850.3284, GNorm = 1.1454, lr_0 = 9.9359e-04
Validation auc = 0.706053
Epoch 9095
Loss = 3.7976e-02, PNorm = 850.3565, GNorm = 2.1304, lr_0 = 9.9359e-04
Validation auc = 0.709177
Epoch 9096
Loss = 4.6384e-03, PNorm = 850.4012, GNorm = 0.3983, lr_0 = 9.9359e-04
Validation auc = 0.707495
Epoch 9097
Loss = 3.6016e-02, PNorm = 850.4350, GNorm = 0.8210, lr_0 = 9.9359e-04
Validation auc = 0.696983
Epoch 9098
Loss = 2.3029e-02, PNorm = 850.4736, GNorm = 2.9486, lr_0 = 9.9359e-04
Validation auc = 0.694776
Epoch 9099
Loss = 4.1411e-02, PNorm = 850.5053, GNorm = 1.4281, lr_0 = 9.9359e-04
Loss = 1.9919e-02, PNorm = 850.5315, GNorm = 0.2244, lr_0 = 9.9359e-04
Validation auc = 0.695998
Epoch 9100
Loss = 3.9363e-02, PNorm = 850.5557, GNorm = 3.2252, lr_0 = 9.9359e-04
Validation auc = 0.700259
Epoch 9101
Loss = 2.7804e-02, PNorm = 850.5770, GNorm = 1.3573, lr_0 = 9.9359e-04
Validation auc = 0.701072
Epoch 9102
Loss = 4.9512e-02, PNorm = 850.5952, GNorm = 7.5108, lr_0 = 9.9359e-04
Validation auc = 0.698570
Epoch 9103
Loss = 2.7541e-02, PNorm = 850.6188, GNorm = 0.3844, lr_0 = 9.9359e-04
Validation auc = 0.699506
Epoch 9104
Loss = 4.9187e-02, PNorm = 850.6443, GNorm = 0.5797, lr_0 = 9.9359e-04
Validation auc = 0.693436
Epoch 9105
Loss = 1.1296e-02, PNorm = 850.6718, GNorm = 0.1790, lr_0 = 9.9359e-04
Validation auc = 0.689508
Epoch 9106
Loss = 1.6152e-02, PNorm = 850.6944, GNorm = 1.8397, lr_0 = 9.9358e-04
Validation auc = 0.690026
Epoch 9107
Loss = 1.0117e-02, PNorm = 850.7212, GNorm = 0.4843, lr_0 = 9.9358e-04
Validation auc = 0.696182
Epoch 9108
Loss = 6.0875e-03, PNorm = 850.7592, GNorm = 0.6829, lr_0 = 9.9358e-04
Validation auc = 0.697229
Epoch 9109
Loss = 7.2767e-03, PNorm = 850.7951, GNorm = 0.4533, lr_0 = 9.9358e-04
Loss = 2.8126e-02, PNorm = 850.8203, GNorm = 1.2781, lr_0 = 9.9358e-04
Validation auc = 0.697005
Epoch 9110
Loss = 5.1260e-02, PNorm = 850.8451, GNorm = 0.3147, lr_0 = 9.9358e-04
Validation auc = 0.696597
Epoch 9111
Loss = 8.0019e-02, PNorm = 850.8792, GNorm = 0.6254, lr_0 = 9.9358e-04
Validation auc = 0.692110
Epoch 9112
Loss = 6.1777e-02, PNorm = 850.9152, GNorm = 9.6121, lr_0 = 9.9358e-04
Validation auc = 0.683783
Epoch 9113
Loss = 4.1174e-02, PNorm = 850.9433, GNorm = 9.1156, lr_0 = 9.9358e-04
Validation auc = 0.671853
Epoch 9114
Loss = 1.8641e-02, PNorm = 850.9930, GNorm = 0.6422, lr_0 = 9.9358e-04
Validation auc = 0.665403
Epoch 9115
Loss = 3.0433e-02, PNorm = 851.0320, GNorm = 2.8664, lr_0 = 9.9358e-04
Validation auc = 0.664864
Epoch 9116
Loss = 7.9415e-02, PNorm = 851.0720, GNorm = 5.1164, lr_0 = 9.9358e-04
Validation auc = 0.666906
Epoch 9117
Loss = 1.7675e-02, PNorm = 851.1124, GNorm = 0.3769, lr_0 = 9.9358e-04
Validation auc = 0.665917
Epoch 9118
Loss = 1.6052e-02, PNorm = 851.1501, GNorm = 0.4117, lr_0 = 9.9358e-04
Validation auc = 0.668427
Epoch 9119
Loss = 3.7517e-02, PNorm = 851.1842, GNorm = 1.7005, lr_0 = 9.9357e-04
Loss = 7.3688e-02, PNorm = 851.2218, GNorm = 3.4116, lr_0 = 9.9357e-04
Validation auc = 0.679932
Epoch 9120
Loss = 6.4646e-02, PNorm = 851.2792, GNorm = 3.8715, lr_0 = 9.9357e-04
Validation auc = 0.684919
Epoch 9121
Loss = 3.9280e-02, PNorm = 851.3249, GNorm = 0.2704, lr_0 = 9.9357e-04
Validation auc = 0.687642
Epoch 9122
Loss = 5.2801e-02, PNorm = 851.3593, GNorm = 0.2492, lr_0 = 9.9357e-04
Validation auc = 0.691509
Epoch 9123
Loss = 7.1290e-03, PNorm = 851.3841, GNorm = 0.7888, lr_0 = 9.9357e-04
Validation auc = 0.692256
Epoch 9124
Loss = 3.0449e-02, PNorm = 851.4003, GNorm = 0.6359, lr_0 = 9.9357e-04
Validation auc = 0.695190
Epoch 9125
Loss = 2.1404e-02, PNorm = 851.4150, GNorm = 0.6024, lr_0 = 9.9357e-04
Validation auc = 0.694563
Epoch 9126
Loss = 1.5597e-02, PNorm = 851.4314, GNorm = 0.8977, lr_0 = 9.9357e-04
Validation auc = 0.690796
Epoch 9127
Loss = 2.0001e-02, PNorm = 851.4498, GNorm = 0.9596, lr_0 = 9.9357e-04
Validation auc = 0.690359
Epoch 9128
Loss = 5.6241e-02, PNorm = 851.4781, GNorm = 2.2414, lr_0 = 9.9357e-04
Validation auc = 0.689726
Epoch 9129
Loss = 9.5586e-03, PNorm = 851.5131, GNorm = 0.3291, lr_0 = 9.9357e-04
Loss = 3.7833e-02, PNorm = 851.5535, GNorm = 0.1863, lr_0 = 9.9357e-04
Validation auc = 0.690864
Epoch 9130
Loss = 1.7977e-02, PNorm = 851.5878, GNorm = 1.0636, lr_0 = 9.9357e-04
Validation auc = 0.686759
Epoch 9131
Loss = 4.5020e-02, PNorm = 851.6154, GNorm = 0.4113, lr_0 = 9.9357e-04
Validation auc = 0.688046
Epoch 9132
Loss = 5.2236e-02, PNorm = 851.6474, GNorm = 0.4630, lr_0 = 9.9356e-04
Validation auc = 0.685264
Epoch 9133
Loss = 1.3127e-02, PNorm = 851.6817, GNorm = 0.3540, lr_0 = 9.9356e-04
Validation auc = 0.684236
Epoch 9134
Loss = 8.3387e-02, PNorm = 851.7124, GNorm = 4.5118, lr_0 = 9.9356e-04
Validation auc = 0.688040
Epoch 9135
Loss = 3.1426e-02, PNorm = 851.7503, GNorm = 1.5480, lr_0 = 9.9356e-04
Validation auc = 0.692147
Epoch 9136
Loss = 1.3448e-01, PNorm = 851.7878, GNorm = 2.1361, lr_0 = 9.9356e-04
Validation auc = 0.713087
Epoch 9137
Loss = 4.8830e-02, PNorm = 851.8472, GNorm = 4.1066, lr_0 = 9.9356e-04
Validation auc = 0.715655
Epoch 9138
Loss = 5.7438e-02, PNorm = 851.8933, GNorm = 1.2402, lr_0 = 9.9356e-04
Validation auc = 0.715404
Epoch 9139
Loss = 1.2331e-01, PNorm = 851.9286, GNorm = 5.1587, lr_0 = 9.9356e-04
Loss = 4.8826e-02, PNorm = 851.9640, GNorm = 1.5484, lr_0 = 9.9356e-04
Validation auc = 0.716766
Epoch 9140
Loss = 7.3974e-02, PNorm = 852.0040, GNorm = 0.5002, lr_0 = 9.9356e-04
Validation auc = 0.720694
Epoch 9141
Loss = 3.1197e-02, PNorm = 852.0421, GNorm = 1.4881, lr_0 = 9.9356e-04
Validation auc = 0.716690
Epoch 9142
Loss = 4.3593e-02, PNorm = 852.0713, GNorm = 0.9677, lr_0 = 9.9356e-04
Validation auc = 0.709672
Epoch 9143
Loss = 3.1000e-02, PNorm = 852.1082, GNorm = 1.8259, lr_0 = 9.9356e-04
Validation auc = 0.708479
Epoch 9144
Loss = 2.7323e-02, PNorm = 852.1476, GNorm = 0.3469, lr_0 = 9.9356e-04
Validation auc = 0.705463
Epoch 9145
Loss = 3.1677e-02, PNorm = 852.1847, GNorm = 0.8703, lr_0 = 9.9356e-04
Validation auc = 0.702664
Epoch 9146
Loss = 1.9224e-02, PNorm = 852.2190, GNorm = 3.0190, lr_0 = 9.9355e-04
Validation auc = 0.702525
Epoch 9147
Loss = 5.5971e-02, PNorm = 852.2450, GNorm = 1.6105, lr_0 = 9.9355e-04
Validation auc = 0.703417
Epoch 9148
Loss = 5.7793e-03, PNorm = 852.2704, GNorm = 0.7944, lr_0 = 9.9355e-04
Validation auc = 0.703004
Epoch 9149
Loss = 1.2473e-02, PNorm = 852.3076, GNorm = 1.3035, lr_0 = 9.9355e-04
Loss = 3.4717e-02, PNorm = 852.3414, GNorm = 1.5494, lr_0 = 9.9355e-04
Validation auc = 0.702503
Epoch 9150
Loss = 4.5295e-02, PNorm = 852.3755, GNorm = 0.0717, lr_0 = 9.9355e-04
Validation auc = 0.702617
Epoch 9151
Loss = 1.2044e-02, PNorm = 852.4019, GNorm = 0.4700, lr_0 = 9.9355e-04
Validation auc = 0.704133
Epoch 9152
Loss = 1.0966e-01, PNorm = 852.4276, GNorm = 3.2693, lr_0 = 9.9355e-04
Validation auc = 0.705043
Epoch 9153
Loss = 6.8116e-02, PNorm = 852.4608, GNorm = 4.6573, lr_0 = 9.9355e-04
Validation auc = 0.702009
Epoch 9154
Loss = 2.3204e-02, PNorm = 852.5144, GNorm = 0.4700, lr_0 = 9.9355e-04
Validation auc = 0.703314
Epoch 9155
Loss = 2.8930e-02, PNorm = 852.5585, GNorm = 1.4196, lr_0 = 9.9355e-04
Validation auc = 0.699105
Epoch 9156
Loss = 6.9228e-02, PNorm = 852.5954, GNorm = 4.7798, lr_0 = 9.9355e-04
Validation auc = 0.696188
Epoch 9157
Loss = 3.7247e-02, PNorm = 852.6374, GNorm = 2.0587, lr_0 = 9.9355e-04
Validation auc = 0.697349
Epoch 9158
Loss = 4.8209e-02, PNorm = 852.6764, GNorm = 1.6953, lr_0 = 9.9355e-04
Validation auc = 0.701526
Epoch 9159
Loss = 7.1269e-03, PNorm = 852.7100, GNorm = 0.5832, lr_0 = 9.9354e-04
Loss = 6.1463e-02, PNorm = 852.7340, GNorm = 11.5815, lr_0 = 9.9354e-04
Validation auc = 0.705640
Epoch 9160
Loss = 2.6004e-02, PNorm = 852.7569, GNorm = 0.6407, lr_0 = 9.9354e-04
Validation auc = 0.705072
Epoch 9161
Loss = 4.0192e-02, PNorm = 852.7853, GNorm = 0.5714, lr_0 = 9.9354e-04
Validation auc = 0.705382
Epoch 9162
Loss = 3.9312e-02, PNorm = 852.8194, GNorm = 0.9552, lr_0 = 9.9354e-04
Validation auc = 0.708498
Epoch 9163
Loss = 3.2246e-02, PNorm = 852.8503, GNorm = 1.6812, lr_0 = 9.9354e-04
Validation auc = 0.711943
Epoch 9164
Loss = 6.1290e-02, PNorm = 852.8769, GNorm = 0.5369, lr_0 = 9.9354e-04
Validation auc = 0.716695
Epoch 9165
Loss = 1.0941e-01, PNorm = 852.9111, GNorm = 1.5966, lr_0 = 9.9354e-04
Validation auc = 0.713147
Epoch 9166
Loss = 3.8488e-02, PNorm = 852.9497, GNorm = 1.9705, lr_0 = 9.9354e-04
Validation auc = 0.709109
Epoch 9167
Loss = 4.0543e-02, PNorm = 852.9852, GNorm = 0.8780, lr_0 = 9.9354e-04
Validation auc = 0.704814
Epoch 9168
Loss = 1.5747e-02, PNorm = 853.0183, GNorm = 0.6864, lr_0 = 9.9354e-04
Validation auc = 0.699157
Epoch 9169
Loss = 5.9577e-03, PNorm = 853.0441, GNorm = 0.4268, lr_0 = 9.9354e-04
Loss = 2.8983e-02, PNorm = 853.0649, GNorm = 4.2698, lr_0 = 9.9354e-04
Validation auc = 0.695165
Epoch 9170
Loss = 6.8419e-02, PNorm = 853.0926, GNorm = 1.8818, lr_0 = 9.9354e-04
Validation auc = 0.689023
Epoch 9171
Loss = 4.7325e-02, PNorm = 853.1265, GNorm = 0.5011, lr_0 = 9.9354e-04
Validation auc = 0.683446
Epoch 9172
Loss = 6.5573e-02, PNorm = 853.1535, GNorm = 4.7465, lr_0 = 9.9353e-04
Validation auc = 0.681595
Epoch 9173
Loss = 1.6515e-02, PNorm = 853.1798, GNorm = 2.2570, lr_0 = 9.9353e-04
Validation auc = 0.681720
Epoch 9174
Loss = 2.3919e-02, PNorm = 853.2027, GNorm = 1.7907, lr_0 = 9.9353e-04
Validation auc = 0.681848
Epoch 9175
Loss = 3.1384e-02, PNorm = 853.2217, GNorm = 3.2483, lr_0 = 9.9353e-04
Validation auc = 0.683355
Epoch 9176
Loss = 3.0630e-02, PNorm = 853.2455, GNorm = 3.5712, lr_0 = 9.9353e-04
Validation auc = 0.685819
Epoch 9177
Loss = 2.6734e-03, PNorm = 853.2724, GNorm = 0.3915, lr_0 = 9.9353e-04
Validation auc = 0.687886
Epoch 9178
Loss = 4.9146e-03, PNorm = 853.3023, GNorm = 0.2573, lr_0 = 9.9353e-04
Validation auc = 0.689923
Epoch 9179
Loss = 2.8221e-02, PNorm = 853.3303, GNorm = 1.7406, lr_0 = 9.9353e-04
Loss = 4.2953e-02, PNorm = 853.3636, GNorm = 1.9845, lr_0 = 9.9353e-04
Validation auc = 0.684176
Epoch 9180
Loss = 2.4050e-02, PNorm = 853.3973, GNorm = 2.0063, lr_0 = 9.9353e-04
Validation auc = 0.683208
Epoch 9181
Loss = 2.4912e-02, PNorm = 853.4267, GNorm = 0.8998, lr_0 = 9.9353e-04
Validation auc = 0.681556
Epoch 9182
Loss = 7.2911e-02, PNorm = 853.4560, GNorm = 0.2213, lr_0 = 9.9353e-04
Validation auc = 0.675369
Epoch 9183
Loss = 1.4386e-02, PNorm = 853.4824, GNorm = 0.4528, lr_0 = 9.9353e-04
Validation auc = 0.676374
Epoch 9184
Loss = 5.2195e-02, PNorm = 853.5019, GNorm = 3.2418, lr_0 = 9.9353e-04
Validation auc = 0.678667
Epoch 9185
Loss = 3.8244e-02, PNorm = 853.5210, GNorm = 0.3300, lr_0 = 9.9352e-04
Validation auc = 0.683035
Epoch 9186
Loss = 5.9623e-02, PNorm = 853.5419, GNorm = 0.9353, lr_0 = 9.9352e-04
Validation auc = 0.681599
Epoch 9187
Loss = 9.3184e-03, PNorm = 853.5658, GNorm = 1.2344, lr_0 = 9.9352e-04
Validation auc = 0.683057
Epoch 9188
Loss = 7.1652e-03, PNorm = 853.5887, GNorm = 0.4467, lr_0 = 9.9352e-04
Validation auc = 0.684885
Epoch 9189
Loss = 3.4513e-03, PNorm = 853.6109, GNorm = 0.3062, lr_0 = 9.9352e-04
Loss = 3.4985e-02, PNorm = 853.6343, GNorm = 0.4111, lr_0 = 9.9352e-04
Validation auc = 0.684101
Epoch 9190
Loss = 4.2069e-02, PNorm = 853.6667, GNorm = 4.9017, lr_0 = 9.9352e-04
Validation auc = 0.687528
Epoch 9191
Loss = 4.3308e-02, PNorm = 853.7069, GNorm = 1.6969, lr_0 = 9.9352e-04
Validation auc = 0.687217
Epoch 9192
Loss = 1.4946e-02, PNorm = 853.7440, GNorm = 2.9215, lr_0 = 9.9352e-04
Validation auc = 0.683032
Epoch 9193
Loss = 2.5035e-02, PNorm = 853.7738, GNorm = 0.2031, lr_0 = 9.9352e-04
Validation auc = 0.676378
Epoch 9194
Loss = 9.9921e-03, PNorm = 853.7983, GNorm = 1.8582, lr_0 = 9.9352e-04
Validation auc = 0.673794
Epoch 9195
Loss = 1.6783e-02, PNorm = 853.8174, GNorm = 0.1653, lr_0 = 9.9352e-04
Validation auc = 0.671034
Epoch 9196
Loss = 4.2344e-02, PNorm = 853.8374, GNorm = 2.7974, lr_0 = 9.9352e-04
Validation auc = 0.669748
Epoch 9197
Loss = 3.7782e-02, PNorm = 853.8692, GNorm = 4.3522, lr_0 = 9.9352e-04
Validation auc = 0.672898
Epoch 9198
Loss = 5.5327e-03, PNorm = 853.8981, GNorm = 0.3496, lr_0 = 9.9352e-04
Validation auc = 0.675645
Epoch 9199
Loss = 1.5379e-02, PNorm = 853.9266, GNorm = 0.6827, lr_0 = 9.9351e-04
Loss = 3.6193e-02, PNorm = 853.9567, GNorm = 1.1268, lr_0 = 9.9351e-04
Validation auc = 0.676227
Epoch 9200
Loss = 4.9771e-02, PNorm = 853.9871, GNorm = 0.3084, lr_0 = 9.9351e-04
Validation auc = 0.674268
Epoch 9201
Loss = 3.1122e-02, PNorm = 854.0187, GNorm = 4.5691, lr_0 = 9.9351e-04
Validation auc = 0.671854
Epoch 9202
Loss = 3.9095e-02, PNorm = 854.0550, GNorm = 1.8921, lr_0 = 9.9351e-04
Validation auc = 0.669095
Epoch 9203
Loss = 3.9911e-02, PNorm = 854.0844, GNorm = 0.4221, lr_0 = 9.9351e-04
Validation auc = 0.669433
Epoch 9204
Loss = 2.6918e-02, PNorm = 854.1167, GNorm = 1.4018, lr_0 = 9.9351e-04
Validation auc = 0.672511
Epoch 9205
Loss = 3.7333e-02, PNorm = 854.1559, GNorm = 4.6900, lr_0 = 9.9351e-04
Validation auc = 0.673647
Epoch 9206
Loss = 7.6762e-02, PNorm = 854.1944, GNorm = 0.4163, lr_0 = 9.9351e-04
Validation auc = 0.674936
Epoch 9207
Loss = 9.4316e-03, PNorm = 854.2320, GNorm = 0.9785, lr_0 = 9.9351e-04
Validation auc = 0.677317
Epoch 9208
Loss = 2.2600e-02, PNorm = 854.2660, GNorm = 1.2864, lr_0 = 9.9351e-04
Validation auc = 0.679364
Epoch 9209
Loss = 1.7047e-02, PNorm = 854.3009, GNorm = 1.0249, lr_0 = 9.9351e-04
Loss = 3.4439e-02, PNorm = 854.3371, GNorm = 2.7689, lr_0 = 9.9351e-04
Validation auc = 0.683190
Epoch 9210
Loss = 3.0872e-02, PNorm = 854.3685, GNorm = 0.3356, lr_0 = 9.9351e-04
Validation auc = 0.683093
Epoch 9211
Loss = 1.7218e-02, PNorm = 854.3940, GNorm = 0.3366, lr_0 = 9.9351e-04
Validation auc = 0.684329
Epoch 9212
Loss = 2.4535e-02, PNorm = 854.4136, GNorm = 2.0869, lr_0 = 9.9350e-04
Validation auc = 0.686822
Epoch 9213
Loss = 7.0866e-02, PNorm = 854.4435, GNorm = 0.3690, lr_0 = 9.9350e-04
Validation auc = 0.683594
Epoch 9214
Loss = 6.3300e-02, PNorm = 854.4806, GNorm = 5.6103, lr_0 = 9.9350e-04
Validation auc = 0.681806
Epoch 9215
Loss = 2.8626e-02, PNorm = 854.5189, GNorm = 1.1854, lr_0 = 9.9350e-04
Validation auc = 0.688323
Epoch 9216
Loss = 6.3187e-02, PNorm = 854.5614, GNorm = 5.8318, lr_0 = 9.9350e-04
Validation auc = 0.690163
Epoch 9217
Loss = 4.9294e-02, PNorm = 854.5997, GNorm = 3.4485, lr_0 = 9.9350e-04
Validation auc = 0.692748
Epoch 9218
Loss = 1.4894e-01, PNorm = 854.6339, GNorm = 1.3613, lr_0 = 9.9350e-04
Validation auc = 0.693927
Epoch 9219
Loss = 4.9268e-02, PNorm = 854.6686, GNorm = 1.9998, lr_0 = 9.9350e-04
Loss = 2.8230e-02, PNorm = 854.6957, GNorm = 3.0927, lr_0 = 9.9350e-04
Validation auc = 0.703533
Epoch 9220
Loss = 1.6454e-02, PNorm = 854.7225, GNorm = 1.1265, lr_0 = 9.9350e-04
Validation auc = 0.705885
Epoch 9221
Loss = 6.1415e-02, PNorm = 854.7511, GNorm = 0.3971, lr_0 = 9.9350e-04
Validation auc = 0.705513
Epoch 9222
Loss = 5.9995e-02, PNorm = 854.7905, GNorm = 0.6177, lr_0 = 9.9350e-04
Validation auc = 0.707414
Epoch 9223
Loss = 7.4339e-02, PNorm = 854.8371, GNorm = 1.3706, lr_0 = 9.9350e-04
Validation auc = 0.700879
Epoch 9224
Loss = 7.7081e-02, PNorm = 854.8873, GNorm = 1.1160, lr_0 = 9.9350e-04
Validation auc = 0.698700
Epoch 9225
Loss = 3.9027e-02, PNorm = 854.9639, GNorm = 0.4363, lr_0 = 9.9349e-04
Validation auc = 0.691730
Epoch 9226
Loss = 5.9250e-02, PNorm = 855.0320, GNorm = 1.4220, lr_0 = 9.9349e-04
Validation auc = 0.696841
Epoch 9227
Loss = 7.0081e-02, PNorm = 855.0960, GNorm = 2.7067, lr_0 = 9.9349e-04
Validation auc = 0.692592
Epoch 9228
Loss = 6.4307e-02, PNorm = 855.1591, GNorm = 1.5196, lr_0 = 9.9349e-04
Validation auc = 0.689223
Epoch 9229
Loss = 9.5132e-03, PNorm = 855.2176, GNorm = 0.6308, lr_0 = 9.9349e-04
Loss = 5.2103e-01, PNorm = 855.2695, GNorm = 162.4917, lr_0 = 9.9349e-04
Validation auc = 0.690388
Epoch 9230
Loss = 7.5717e-02, PNorm = 855.3620, GNorm = 2.3022, lr_0 = 9.9349e-04
Validation auc = 0.681825
Epoch 9231
Loss = 1.0040e-01, PNorm = 855.4420, GNorm = 7.6659, lr_0 = 9.9349e-04
Validation auc = 0.686289
Epoch 9232
Loss = 9.7066e-02, PNorm = 855.5082, GNorm = 1.9668, lr_0 = 9.9349e-04
Validation auc = 0.694684
Epoch 9233
Loss = 6.5058e-02, PNorm = 855.5705, GNorm = 2.8352, lr_0 = 9.9349e-04
Validation auc = 0.691068
Epoch 9234
Loss = 5.2044e-02, PNorm = 855.6312, GNorm = 1.0613, lr_0 = 9.9349e-04
Validation auc = 0.691951
Epoch 9235
Loss = 3.4989e-02, PNorm = 855.6924, GNorm = 0.4014, lr_0 = 9.9349e-04
Validation auc = 0.692910
Epoch 9236
Loss = 2.0027e-02, PNorm = 855.7478, GNorm = 2.9282, lr_0 = 9.9349e-04
Validation auc = 0.691626
Epoch 9237
Loss = 3.6440e-02, PNorm = 855.7933, GNorm = 0.2963, lr_0 = 9.9349e-04
Validation auc = 0.687436
Epoch 9238
Loss = 3.8982e-02, PNorm = 855.8329, GNorm = 2.6225, lr_0 = 9.9349e-04
Validation auc = 0.681699
Epoch 9239
Loss = 5.4600e-03, PNorm = 855.8720, GNorm = 0.3902, lr_0 = 9.9348e-04
Loss = 3.1951e-02, PNorm = 855.9093, GNorm = 3.5606, lr_0 = 9.9348e-04
Validation auc = 0.683755
Epoch 9240
Loss = 5.4798e-02, PNorm = 855.9448, GNorm = 6.3627, lr_0 = 9.9348e-04
Validation auc = 0.681817
Epoch 9241
Loss = 4.8119e-02, PNorm = 855.9832, GNorm = 1.3526, lr_0 = 9.9348e-04
Validation auc = 0.681639
Epoch 9242
Loss = 5.1223e-02, PNorm = 856.0279, GNorm = 4.5835, lr_0 = 9.9348e-04
Validation auc = 0.685920
Epoch 9243
Loss = 4.5249e-02, PNorm = 856.0695, GNorm = 3.1720, lr_0 = 9.9348e-04
Validation auc = 0.688975
Epoch 9244
Loss = 4.7095e-02, PNorm = 856.1325, GNorm = 0.8939, lr_0 = 9.9348e-04
Validation auc = 0.682694
Epoch 9245
Loss = 2.1487e-02, PNorm = 856.1851, GNorm = 2.5742, lr_0 = 9.9348e-04
Validation auc = 0.680953
Epoch 9246
Loss = 2.6631e-02, PNorm = 856.2351, GNorm = 1.2680, lr_0 = 9.9348e-04
Validation auc = 0.682436
Epoch 9247
Loss = 1.9697e-02, PNorm = 856.2829, GNorm = 0.5319, lr_0 = 9.9348e-04
Validation auc = 0.682976
Epoch 9248
Loss = 1.3601e-01, PNorm = 856.3168, GNorm = 14.0997, lr_0 = 9.9348e-04
Validation auc = 0.688680
Epoch 9249
Loss = 2.3845e-02, PNorm = 856.3630, GNorm = 2.3455, lr_0 = 9.9348e-04
Loss = 3.9677e-02, PNorm = 856.4038, GNorm = 1.7418, lr_0 = 9.9348e-04
Validation auc = 0.693803
Epoch 9250
Loss = 5.3123e-02, PNorm = 856.4464, GNorm = 3.2907, lr_0 = 9.9348e-04
Validation auc = 0.692380
Epoch 9251
Loss = 6.4421e-02, PNorm = 856.5050, GNorm = 0.5501, lr_0 = 9.9348e-04
Validation auc = 0.689735
Epoch 9252
Loss = 3.1629e-02, PNorm = 856.5680, GNorm = 1.5281, lr_0 = 9.9347e-04
Validation auc = 0.692124
Epoch 9253
Loss = 3.9051e-02, PNorm = 856.6188, GNorm = 0.4779, lr_0 = 9.9347e-04
Validation auc = 0.695367
Epoch 9254
Loss = 4.7806e-02, PNorm = 856.6654, GNorm = 3.0757, lr_0 = 9.9347e-04
Validation auc = 0.697975
Epoch 9255
Loss = 5.9940e-02, PNorm = 856.7044, GNorm = 3.2702, lr_0 = 9.9347e-04
Validation auc = 0.699857
Epoch 9256
Loss = 2.8587e-02, PNorm = 856.7421, GNorm = 0.3936, lr_0 = 9.9347e-04
Validation auc = 0.697372
Epoch 9257
Loss = 8.9496e-02, PNorm = 856.7994, GNorm = 6.4183, lr_0 = 9.9347e-04
Validation auc = 0.695345
Epoch 9258
Loss = 8.6291e-02, PNorm = 856.8641, GNorm = 1.9992, lr_0 = 9.9347e-04
Validation auc = 0.694569
Epoch 9259
Loss = 2.0124e-02, PNorm = 856.9163, GNorm = 1.0038, lr_0 = 9.9347e-04
Loss = 6.7969e-02, PNorm = 856.9602, GNorm = 14.7253, lr_0 = 9.9347e-04
Validation auc = 0.698287
Epoch 9260
Loss = 1.4164e-01, PNorm = 857.0041, GNorm = 0.9971, lr_0 = 9.9347e-04
Validation auc = 0.693660
Epoch 9261
Loss = 1.0132e-01, PNorm = 857.0757, GNorm = 3.3217, lr_0 = 9.9347e-04
Validation auc = 0.691319
Epoch 9262
Loss = 4.7383e-02, PNorm = 857.1465, GNorm = 3.1113, lr_0 = 9.9347e-04
Validation auc = 0.690471
Epoch 9263
Loss = 1.7482e-01, PNorm = 857.2067, GNorm = 0.2183, lr_0 = 9.9347e-04
Validation auc = 0.693222
Epoch 9264
Loss = 2.0231e-01, PNorm = 857.2949, GNorm = 3.8270, lr_0 = 9.9347e-04
Validation auc = 0.695064
Epoch 9265
Loss = 2.4523e-01, PNorm = 857.3805, GNorm = 1.8438, lr_0 = 9.9346e-04
Validation auc = 0.704881
Epoch 9266
Loss = 7.8536e-02, PNorm = 857.4826, GNorm = 1.9506, lr_0 = 9.9346e-04
Validation auc = 0.695643
Epoch 9267
Loss = 5.7570e-02, PNorm = 857.5638, GNorm = 2.7399, lr_0 = 9.9346e-04
Validation auc = 0.700465
Epoch 9268
Loss = 1.9938e-02, PNorm = 857.6214, GNorm = 0.9351, lr_0 = 9.9346e-04
Validation auc = 0.698959
Epoch 9269
Loss = 1.9779e-02, PNorm = 857.6663, GNorm = 0.8491, lr_0 = 9.9346e-04
Loss = 6.1265e-02, PNorm = 857.7088, GNorm = 4.3542, lr_0 = 9.9346e-04
Validation auc = 0.702463
Epoch 9270
Loss = 7.4027e-02, PNorm = 857.7558, GNorm = 1.4561, lr_0 = 9.9346e-04
Validation auc = 0.702741
Epoch 9271
Loss = 6.9551e-02, PNorm = 857.7966, GNorm = 6.4291, lr_0 = 9.9346e-04
Validation auc = 0.701811
Epoch 9272
Loss = 9.3043e-02, PNorm = 857.8439, GNorm = 0.3754, lr_0 = 9.9346e-04
Validation auc = 0.696885
Epoch 9273
Loss = 2.6408e-02, PNorm = 857.8873, GNorm = 1.5336, lr_0 = 9.9346e-04
Validation auc = 0.691709
Epoch 9274
Loss = 2.6376e-02, PNorm = 857.9199, GNorm = 0.3673, lr_0 = 9.9346e-04
Validation auc = 0.689384
Epoch 9275
Loss = 9.3039e-02, PNorm = 857.9499, GNorm = 4.7095, lr_0 = 9.9346e-04
Validation auc = 0.686250
Epoch 9276
Loss = 2.8757e-02, PNorm = 857.9955, GNorm = 1.7019, lr_0 = 9.9346e-04
Validation auc = 0.689459
Epoch 9277
Loss = 7.7274e-02, PNorm = 858.0298, GNorm = 3.4656, lr_0 = 9.9346e-04
Validation auc = 0.692292
Epoch 9278
Loss = 1.8494e-02, PNorm = 858.0598, GNorm = 0.9837, lr_0 = 9.9346e-04
Validation auc = 0.681980
Epoch 9279
Loss = 7.4131e-02, PNorm = 858.0953, GNorm = 2.2789, lr_0 = 9.9345e-04
Loss = 5.2887e-02, PNorm = 858.1347, GNorm = 1.4348, lr_0 = 9.9345e-04
Validation auc = 0.674122
Epoch 9280
Loss = 6.3867e-02, PNorm = 858.1757, GNorm = 17.0807, lr_0 = 9.9345e-04
Validation auc = 0.674973
Epoch 9281
Loss = 6.9682e-02, PNorm = 858.2242, GNorm = 0.5426, lr_0 = 9.9345e-04
Validation auc = 0.672618
Epoch 9282
Loss = 3.9800e-02, PNorm = 858.2728, GNorm = 0.3135, lr_0 = 9.9345e-04
Validation auc = 0.677394
Epoch 9283
Loss = 1.2527e-02, PNorm = 858.3161, GNorm = 2.5741, lr_0 = 9.9345e-04
Validation auc = 0.680591
Epoch 9284
Loss = 3.5499e-02, PNorm = 858.3522, GNorm = 2.7297, lr_0 = 9.9345e-04
Validation auc = 0.677236
Epoch 9285
Loss = 3.3995e-02, PNorm = 858.3981, GNorm = 0.7877, lr_0 = 9.9345e-04
Validation auc = 0.674627
Epoch 9286
Loss = 9.2757e-02, PNorm = 858.4415, GNorm = 4.6072, lr_0 = 9.9345e-04
Validation auc = 0.682035
Epoch 9287
Loss = 6.8463e-02, PNorm = 858.4864, GNorm = 0.6433, lr_0 = 9.9345e-04
Validation auc = 0.689914
Epoch 9288
Loss = 3.1594e-02, PNorm = 858.5267, GNorm = 1.6479, lr_0 = 9.9345e-04
Validation auc = 0.696387
Epoch 9289
Loss = 8.7197e-03, PNorm = 858.5717, GNorm = 0.5240, lr_0 = 9.9345e-04
Loss = 2.2637e-02, PNorm = 858.6438, GNorm = 2.5822, lr_0 = 9.9345e-04
Validation auc = 0.696201
Epoch 9290
Loss = 4.2552e-02, PNorm = 858.6937, GNorm = 2.9494, lr_0 = 9.9345e-04
Validation auc = 0.696139
Epoch 9291
Loss = 6.1167e-02, PNorm = 858.7465, GNorm = 2.2768, lr_0 = 9.9344e-04
Validation auc = 0.693556
Epoch 9292
Loss = 8.0034e-02, PNorm = 858.8021, GNorm = 0.3490, lr_0 = 9.9344e-04
Validation auc = 0.694830
Epoch 9293
Loss = 6.9975e-02, PNorm = 858.8500, GNorm = 6.0650, lr_0 = 9.9344e-04
Validation auc = 0.689847
Epoch 9294
Loss = 1.0195e-01, PNorm = 858.9020, GNorm = 8.9086, lr_0 = 9.9344e-04
Validation auc = 0.682136
Epoch 9295
Loss = 1.4608e-01, PNorm = 858.9565, GNorm = 6.9555, lr_0 = 9.9344e-04
Validation auc = 0.679745
Epoch 9296
Loss = 1.1417e-01, PNorm = 859.0177, GNorm = 1.1794, lr_0 = 9.9344e-04
Validation auc = 0.690138
Epoch 9297
Loss = 7.2919e-02, PNorm = 859.0761, GNorm = 2.4402, lr_0 = 9.9344e-04
Validation auc = 0.698239
Epoch 9298
Loss = 1.6123e-02, PNorm = 859.1297, GNorm = 0.7324, lr_0 = 9.9344e-04
Validation auc = 0.703160
Epoch 9299
Loss = 9.7532e-03, PNorm = 859.1728, GNorm = 0.5958, lr_0 = 9.9344e-04
Loss = 3.3819e-02, PNorm = 859.2026, GNorm = 0.5765, lr_0 = 9.9344e-04
Validation auc = 0.706402
Epoch 9300
Loss = 4.4143e-02, PNorm = 859.2253, GNorm = 3.8847, lr_0 = 9.9344e-04
Validation auc = 0.706224
Epoch 9301
Loss = 5.0912e-02, PNorm = 859.2575, GNorm = 0.4245, lr_0 = 9.9344e-04
Validation auc = 0.701695
Epoch 9302
Loss = 5.1707e-02, PNorm = 859.3035, GNorm = 0.9647, lr_0 = 9.9344e-04
Validation auc = 0.698021
Epoch 9303
Loss = 3.1772e-02, PNorm = 859.3475, GNorm = 3.4379, lr_0 = 9.9344e-04
Validation auc = 0.696874
Epoch 9304
Loss = 4.0487e-02, PNorm = 859.3863, GNorm = 1.2125, lr_0 = 9.9344e-04
Validation auc = 0.695120
Epoch 9305
Loss = 5.8581e-02, PNorm = 859.4177, GNorm = 5.1473, lr_0 = 9.9343e-04
Validation auc = 0.697045
Epoch 9306
Loss = 9.9639e-03, PNorm = 859.4492, GNorm = 0.6290, lr_0 = 9.9343e-04
Validation auc = 0.696070
Epoch 9307
Loss = 3.5211e-02, PNorm = 859.4753, GNorm = 0.4322, lr_0 = 9.9343e-04
Validation auc = 0.695071
Epoch 9308
Loss = 1.0578e-01, PNorm = 859.5068, GNorm = 2.0741, lr_0 = 9.9343e-04
Validation auc = 0.692952
Epoch 9309
Loss = 1.4815e-01, PNorm = 859.5527, GNorm = 4.3908, lr_0 = 9.9343e-04
Loss = 6.4650e-02, PNorm = 859.6033, GNorm = 2.3115, lr_0 = 9.9343e-04
Validation auc = 0.693417
Epoch 9310
Loss = 6.2285e-02, PNorm = 859.6505, GNorm = 1.1364, lr_0 = 9.9343e-04
Validation auc = 0.691380
Epoch 9311
Loss = 3.8842e-02, PNorm = 859.6914, GNorm = 0.4045, lr_0 = 9.9343e-04
Validation auc = 0.694037
Epoch 9312
Loss = 2.6632e-02, PNorm = 859.7265, GNorm = 0.1994, lr_0 = 9.9343e-04
Validation auc = 0.698544
Epoch 9313
Loss = 1.6321e-02, PNorm = 859.7553, GNorm = 1.3825, lr_0 = 9.9343e-04
Validation auc = 0.701030
Epoch 9314
Loss = 1.0201e-01, PNorm = 859.7889, GNorm = 1.1206, lr_0 = 9.9343e-04
Validation auc = 0.702517
Epoch 9315
Loss = 3.5640e-02, PNorm = 859.8245, GNorm = 1.0834, lr_0 = 9.9343e-04
Validation auc = 0.703176
Epoch 9316
Loss = 5.0219e-02, PNorm = 859.8554, GNorm = 7.1328, lr_0 = 9.9343e-04
Validation auc = 0.699394
Epoch 9317
Loss = 1.8441e-02, PNorm = 859.8891, GNorm = 1.7230, lr_0 = 9.9343e-04
Validation auc = 0.699740
Epoch 9318
Loss = 3.0076e-02, PNorm = 859.9199, GNorm = 0.2879, lr_0 = 9.9343e-04
Validation auc = 0.693582
Epoch 9319
Loss = 1.2307e-02, PNorm = 859.9617, GNorm = 0.5774, lr_0 = 9.9342e-04
Loss = 4.6405e-02, PNorm = 860.0027, GNorm = 2.8533, lr_0 = 9.9342e-04
Validation auc = 0.692938
Epoch 9320
Loss = 5.1502e-02, PNorm = 860.0411, GNorm = 6.7069, lr_0 = 9.9342e-04
Validation auc = 0.691521
Epoch 9321
Loss = 6.2908e-02, PNorm = 860.0801, GNorm = 2.7023, lr_0 = 9.9342e-04
Validation auc = 0.697913
Epoch 9322
Loss = 8.4827e-02, PNorm = 860.1269, GNorm = 2.9684, lr_0 = 9.9342e-04
Validation auc = 0.697349
Epoch 9323
Loss = 2.4195e-02, PNorm = 860.1749, GNorm = 1.1770, lr_0 = 9.9342e-04
Validation auc = 0.696945
Epoch 9324
Loss = 1.7824e-02, PNorm = 860.2111, GNorm = 2.0008, lr_0 = 9.9342e-04
Validation auc = 0.701889
Epoch 9325
Loss = 3.9753e-02, PNorm = 860.2392, GNorm = 0.1581, lr_0 = 9.9342e-04
Validation auc = 0.706874
Epoch 9326
Loss = 3.0137e-01, PNorm = 860.2689, GNorm = 1.4356, lr_0 = 9.9342e-04
Validation auc = 0.697270
Epoch 9327
Loss = 7.0861e-02, PNorm = 860.3178, GNorm = 0.4827, lr_0 = 9.9342e-04
Validation auc = 0.680293
Epoch 9328
Loss = 8.3878e-03, PNorm = 860.3679, GNorm = 0.1710, lr_0 = 9.9342e-04
Validation auc = 0.681105
Epoch 9329
Loss = 1.8064e-02, PNorm = 860.4084, GNorm = 1.5962, lr_0 = 9.9342e-04
Loss = 6.5692e-02, PNorm = 860.4461, GNorm = 15.1240, lr_0 = 9.9342e-04
Validation auc = 0.680418
Epoch 9330
Loss = 7.6494e-02, PNorm = 860.4926, GNorm = 1.5642, lr_0 = 9.9342e-04
Validation auc = 0.685238
Epoch 9331
Loss = 3.0906e-02, PNorm = 860.5382, GNorm = 2.0218, lr_0 = 9.9341e-04
Validation auc = 0.686684
Epoch 9332
Loss = 4.2886e-02, PNorm = 860.5758, GNorm = 4.9527, lr_0 = 9.9341e-04
Validation auc = 0.687112
Epoch 9333
Loss = 3.2500e-02, PNorm = 860.6048, GNorm = 0.9751, lr_0 = 9.9341e-04
Validation auc = 0.684414
Epoch 9334
Loss = 3.0354e-02, PNorm = 860.6319, GNorm = 0.2909, lr_0 = 9.9341e-04
Validation auc = 0.679835
Epoch 9335
Loss = 3.3700e-02, PNorm = 860.6610, GNorm = 2.4673, lr_0 = 9.9341e-04
Validation auc = 0.677550
Epoch 9336
Loss = 1.6619e-02, PNorm = 860.6999, GNorm = 0.5985, lr_0 = 9.9341e-04
Validation auc = 0.678976
Epoch 9337
Loss = 2.1504e-01, PNorm = 860.7399, GNorm = 1.1889, lr_0 = 9.9341e-04
Validation auc = 0.673079
Epoch 9338
Loss = 2.0636e-02, PNorm = 860.7860, GNorm = 2.0497, lr_0 = 9.9341e-04
Validation auc = 0.667398
Epoch 9339
Loss = 8.4068e-02, PNorm = 860.8211, GNorm = 3.6834, lr_0 = 9.9341e-04
Loss = 9.5970e-02, PNorm = 860.8570, GNorm = 1.7823, lr_0 = 9.9341e-04
Validation auc = 0.668493
Epoch 9340
Loss = 5.4817e-02, PNorm = 860.8992, GNorm = 2.5718, lr_0 = 9.9341e-04
Validation auc = 0.670650
Epoch 9341
Loss = 6.9440e-02, PNorm = 860.9388, GNorm = 0.6264, lr_0 = 9.9341e-04
Validation auc = 0.674588
Epoch 9342
Loss = 2.5434e-02, PNorm = 860.9770, GNorm = 0.9330, lr_0 = 9.9341e-04
Validation auc = 0.674522
Epoch 9343
Loss = 5.4598e-02, PNorm = 861.0107, GNorm = 1.5783, lr_0 = 9.9341e-04
Validation auc = 0.671244
Epoch 9344
Loss = 2.4589e-02, PNorm = 861.0433, GNorm = 0.6395, lr_0 = 9.9341e-04
Validation auc = 0.672261
Epoch 9345
Loss = 4.6216e-02, PNorm = 861.0777, GNorm = 6.7779, lr_0 = 9.9340e-04
Validation auc = 0.675533
Epoch 9346
Loss = 6.3259e-02, PNorm = 861.1094, GNorm = 0.5950, lr_0 = 9.9340e-04
Validation auc = 0.672642
Epoch 9347
Loss = 3.9491e-02, PNorm = 861.1470, GNorm = 3.4685, lr_0 = 9.9340e-04
Validation auc = 0.669113
Epoch 9348
Loss = 2.3569e-02, PNorm = 861.1874, GNorm = 1.3157, lr_0 = 9.9340e-04
Validation auc = 0.664155
Epoch 9349
Loss = 9.6704e-02, PNorm = 861.2251, GNorm = 12.6251, lr_0 = 9.9340e-04
Loss = 3.8305e-02, PNorm = 861.2588, GNorm = 0.5534, lr_0 = 9.9340e-04
Validation auc = 0.667356
Epoch 9350
Loss = 7.0019e-02, PNorm = 861.2934, GNorm = 4.3815, lr_0 = 9.9340e-04
Validation auc = 0.667204
Epoch 9351
Loss = 3.0354e-02, PNorm = 861.3379, GNorm = 1.5945, lr_0 = 9.9340e-04
Validation auc = 0.662576
Epoch 9352
Loss = 2.2311e-02, PNorm = 861.3759, GNorm = 1.8433, lr_0 = 9.9340e-04
Validation auc = 0.662314
Epoch 9353
Loss = 3.5741e-02, PNorm = 861.4091, GNorm = 1.4091, lr_0 = 9.9340e-04
Validation auc = 0.669587
Epoch 9354
Loss = 3.4745e-02, PNorm = 861.4500, GNorm = 1.2848, lr_0 = 9.9340e-04
Validation auc = 0.675355
Epoch 9355
Loss = 1.0508e-01, PNorm = 861.4914, GNorm = 8.7064, lr_0 = 9.9340e-04
Validation auc = 0.677401
Epoch 9356
Loss = 5.9515e-02, PNorm = 861.5334, GNorm = 2.4117, lr_0 = 9.9340e-04
Validation auc = 0.671816
Epoch 9357
Loss = 1.8860e-02, PNorm = 861.5769, GNorm = 1.1509, lr_0 = 9.9340e-04
Validation auc = 0.672599
Epoch 9358
Loss = 2.5397e-02, PNorm = 861.6282, GNorm = 0.7247, lr_0 = 9.9339e-04
Validation auc = 0.668335
Epoch 9359
Loss = 1.4729e-02, PNorm = 861.6701, GNorm = 0.8918, lr_0 = 9.9339e-04
Loss = 3.3336e-02, PNorm = 861.7019, GNorm = 5.3542, lr_0 = 9.9339e-04
Validation auc = 0.670926
Epoch 9360
Loss = 3.7355e-02, PNorm = 861.7287, GNorm = 0.3994, lr_0 = 9.9339e-04
Validation auc = 0.671947
Epoch 9361
Loss = 1.6888e-02, PNorm = 861.7662, GNorm = 0.4429, lr_0 = 9.9339e-04
Validation auc = 0.670045
Epoch 9362
Loss = 2.6137e-02, PNorm = 861.7987, GNorm = 2.0751, lr_0 = 9.9339e-04
Validation auc = 0.671110
Epoch 9363
Loss = 2.6669e-02, PNorm = 861.8293, GNorm = 1.3154, lr_0 = 9.9339e-04
Validation auc = 0.669901
Epoch 9364
Loss = 1.2813e-02, PNorm = 861.8634, GNorm = 0.6659, lr_0 = 9.9339e-04
Validation auc = 0.666656
Epoch 9365
Loss = 3.1588e-02, PNorm = 861.8975, GNorm = 5.3667, lr_0 = 9.9339e-04
Validation auc = 0.658291
Epoch 9366
Loss = 1.1638e-01, PNorm = 861.9320, GNorm = 0.6672, lr_0 = 9.9339e-04
Validation auc = 0.658735
Epoch 9367
Loss = 3.6122e-02, PNorm = 861.9662, GNorm = 5.9625, lr_0 = 9.9339e-04
Validation auc = 0.661058
Epoch 9368
Loss = 3.5612e-02, PNorm = 862.0041, GNorm = 1.8355, lr_0 = 9.9339e-04
Validation auc = 0.667362
Epoch 9369
Loss = 5.5368e-02, PNorm = 862.0432, GNorm = 17.5939, lr_0 = 9.9339e-04
Loss = 2.6193e-02, PNorm = 862.0871, GNorm = 1.9610, lr_0 = 9.9339e-04
Validation auc = 0.669531
Epoch 9370
Loss = 2.0597e-02, PNorm = 862.1235, GNorm = 0.2990, lr_0 = 9.9339e-04
Validation auc = 0.673481
Epoch 9371
Loss = 3.3923e-02, PNorm = 862.1500, GNorm = 2.9203, lr_0 = 9.9338e-04
Validation auc = 0.674971
Epoch 9372
Loss = 2.3870e-02, PNorm = 862.1776, GNorm = 1.2776, lr_0 = 9.9338e-04
Validation auc = 0.672266
Epoch 9373
Loss = 1.9831e-02, PNorm = 862.2052, GNorm = 0.2200, lr_0 = 9.9338e-04
Validation auc = 0.672653
Epoch 9374
Loss = 1.5945e-02, PNorm = 862.2336, GNorm = 1.7651, lr_0 = 9.9338e-04
Validation auc = 0.673824
Epoch 9375
Loss = 4.1970e-02, PNorm = 862.2614, GNorm = 4.2975, lr_0 = 9.9338e-04
Validation auc = 0.671332
Epoch 9376
Loss = 2.9605e-02, PNorm = 862.2910, GNorm = 5.5189, lr_0 = 9.9338e-04
Validation auc = 0.668684
Epoch 9377
Loss = 5.1511e-02, PNorm = 862.3210, GNorm = 3.8055, lr_0 = 9.9338e-04
Validation auc = 0.673301
Epoch 9378
Loss = 1.0155e-02, PNorm = 862.3560, GNorm = 0.1537, lr_0 = 9.9338e-04
Validation auc = 0.676764
Epoch 9379
Loss = 1.9481e-03, PNorm = 862.3827, GNorm = 0.2275, lr_0 = 9.9338e-04
Loss = 6.0606e-02, PNorm = 862.4258, GNorm = 0.0616, lr_0 = 9.9338e-04
Validation auc = 0.678831
Epoch 9380
Loss = 3.5718e-02, PNorm = 862.4695, GNorm = 0.3824, lr_0 = 9.9338e-04
Validation auc = 0.673603
Epoch 9381
Loss = 4.4770e-02, PNorm = 862.5044, GNorm = 0.7815, lr_0 = 9.9338e-04
Validation auc = 0.665592
Epoch 9382
Loss = 4.0629e-02, PNorm = 862.5386, GNorm = 2.6414, lr_0 = 9.9338e-04
Validation auc = 0.670103
Epoch 9383
Loss = 5.0310e-02, PNorm = 862.5783, GNorm = 15.4572, lr_0 = 9.9338e-04
Validation auc = 0.680907
Epoch 9384
Loss = 2.2222e-02, PNorm = 862.6280, GNorm = 4.1366, lr_0 = 9.9338e-04
Validation auc = 0.691063
Epoch 9385
Loss = 5.4260e-02, PNorm = 862.6676, GNorm = 2.2704, lr_0 = 9.9337e-04
Validation auc = 0.696169
Epoch 9386
Loss = 3.8603e-02, PNorm = 862.7053, GNorm = 0.5900, lr_0 = 9.9337e-04
Validation auc = 0.693481
Epoch 9387
Loss = 2.0865e-02, PNorm = 862.7489, GNorm = 1.2341, lr_0 = 9.9337e-04
Validation auc = 0.686002
Epoch 9388
Loss = 1.5766e-01, PNorm = 862.7841, GNorm = 5.6351, lr_0 = 9.9337e-04
Validation auc = 0.682072
Epoch 9389
Loss = 4.9085e-02, PNorm = 862.8129, GNorm = 2.2966, lr_0 = 9.9337e-04
Loss = 4.9990e-02, PNorm = 862.8421, GNorm = 2.3467, lr_0 = 9.9337e-04
Validation auc = 0.680166
Epoch 9390
Loss = 4.0213e-02, PNorm = 862.8722, GNorm = 4.0300, lr_0 = 9.9337e-04
Validation auc = 0.683354
Epoch 9391
Loss = 3.9574e-02, PNorm = 862.9087, GNorm = 1.2405, lr_0 = 9.9337e-04
Validation auc = 0.680960
Epoch 9392
Loss = 5.9517e-02, PNorm = 862.9495, GNorm = 1.1642, lr_0 = 9.9337e-04
Validation auc = 0.677837
Epoch 9393
Loss = 5.1314e-02, PNorm = 862.9839, GNorm = 1.5604, lr_0 = 9.9337e-04
Validation auc = 0.677844
Epoch 9394
Loss = 5.8877e-02, PNorm = 863.0139, GNorm = 1.9518, lr_0 = 9.9337e-04
Validation auc = 0.676951
Epoch 9395
Loss = 4.9102e-02, PNorm = 863.0476, GNorm = 3.1637, lr_0 = 9.9337e-04
Validation auc = 0.675264
Epoch 9396
Loss = 5.1399e-02, PNorm = 863.0903, GNorm = 0.4833, lr_0 = 9.9337e-04
Validation auc = 0.673435
Epoch 9397
Loss = 3.2419e-02, PNorm = 863.1304, GNorm = 1.3171, lr_0 = 9.9337e-04
Validation auc = 0.673430
Epoch 9398
Loss = 8.9428e-03, PNorm = 863.1609, GNorm = 0.2795, lr_0 = 9.9336e-04
Validation auc = 0.675949
Epoch 9399
Loss = 1.3593e-02, PNorm = 863.1889, GNorm = 0.7453, lr_0 = 9.9336e-04
Loss = 3.2887e-02, PNorm = 863.2176, GNorm = 0.3165, lr_0 = 9.9336e-04
Validation auc = 0.680747
Epoch 9400
Loss = 5.5227e-02, PNorm = 863.2678, GNorm = 1.8299, lr_0 = 9.9336e-04
Validation auc = 0.669750
Epoch 9401
Loss = 1.8236e-02, PNorm = 863.3142, GNorm = 0.0879, lr_0 = 9.9336e-04
Validation auc = 0.664966
Epoch 9402
Loss = 4.3759e-02, PNorm = 863.3511, GNorm = 5.4571, lr_0 = 9.9336e-04
Validation auc = 0.657165
Epoch 9403
Loss = 2.5199e-02, PNorm = 863.3857, GNorm = 0.6274, lr_0 = 9.9336e-04
Validation auc = 0.653237
Epoch 9404
Loss = 5.0472e-02, PNorm = 863.4189, GNorm = 0.7074, lr_0 = 9.9336e-04
Validation auc = 0.652873
Epoch 9405
Loss = 4.7679e-02, PNorm = 863.4511, GNorm = 0.3015, lr_0 = 9.9336e-04
Validation auc = 0.663094
Epoch 9406
Loss = 5.0333e-02, PNorm = 863.4916, GNorm = 2.9672, lr_0 = 9.9336e-04
Validation auc = 0.676139
Epoch 9407
Loss = 4.8427e-02, PNorm = 863.5372, GNorm = 0.4643, lr_0 = 9.9336e-04
Validation auc = 0.672623
Epoch 9408
Loss = 4.4148e-02, PNorm = 863.5798, GNorm = 0.2537, lr_0 = 9.9336e-04
Validation auc = 0.667138
Epoch 9409
Loss = 1.1462e-02, PNorm = 863.6152, GNorm = 0.5905, lr_0 = 9.9336e-04
Loss = 4.8828e-02, PNorm = 863.6460, GNorm = 0.9332, lr_0 = 9.9336e-04
Validation auc = 0.668632
Epoch 9410
Loss = 2.0319e-02, PNorm = 863.6781, GNorm = 2.6818, lr_0 = 9.9336e-04
Validation auc = 0.672464
Epoch 9411
Loss = 6.1980e-02, PNorm = 863.7182, GNorm = 0.1719, lr_0 = 9.9335e-04
Validation auc = 0.685162
Epoch 9412
Loss = 2.0629e-01, PNorm = 863.9609, GNorm = 7.0535, lr_0 = 9.9335e-04
Validation auc = 0.697388
Epoch 9413
Loss = 4.9091e-01, PNorm = 864.1629, GNorm = 5.5725, lr_0 = 9.9335e-04
Validation auc = 0.694493
Epoch 9414
Loss = 4.1125e-01, PNorm = 864.3222, GNorm = 11.6769, lr_0 = 9.9335e-04
Validation auc = 0.685015
Epoch 9415
Loss = 3.5319e-01, PNorm = 864.4531, GNorm = 17.9522, lr_0 = 9.9335e-04
Validation auc = 0.702936
Epoch 9416
Loss = 2.5643e-01, PNorm = 864.6059, GNorm = 3.5723, lr_0 = 9.9335e-04
Validation auc = 0.715973
Epoch 9417
Loss = 2.5969e-01, PNorm = 864.7498, GNorm = 3.9472, lr_0 = 9.9335e-04
Validation auc = 0.721082
Epoch 9418
Loss = 1.2771e-01, PNorm = 864.8550, GNorm = 3.3127, lr_0 = 9.9335e-04
Validation auc = 0.724036
Epoch 9419
Loss = 3.4629e-01, PNorm = 864.9764, GNorm = 9.5421, lr_0 = 9.9335e-04
Loss = 1.1260e-01, PNorm = 865.0900, GNorm = 5.2513, lr_0 = 9.9335e-04
Validation auc = 0.715313
Epoch 9420
Loss = 2.0070e-01, PNorm = 865.1939, GNorm = 4.9048, lr_0 = 9.9335e-04
Validation auc = 0.700866
Epoch 9421
Loss = 1.1294e-01, PNorm = 865.2871, GNorm = 1.8317, lr_0 = 9.9335e-04
Validation auc = 0.703771
Epoch 9422
Loss = 1.0407e-01, PNorm = 865.3585, GNorm = 2.8184, lr_0 = 9.9335e-04
Validation auc = 0.706174
Epoch 9423
Loss = 7.5793e-02, PNorm = 865.4340, GNorm = 1.9523, lr_0 = 9.9335e-04
Validation auc = 0.706228
Epoch 9424
Loss = 1.0910e-01, PNorm = 865.4968, GNorm = 1.9397, lr_0 = 9.9335e-04
Validation auc = 0.708704
Epoch 9425
Loss = 7.5642e-02, PNorm = 865.5621, GNorm = 0.5793, lr_0 = 9.9334e-04
Validation auc = 0.708927
Epoch 9426
Loss = 3.0006e-02, PNorm = 865.6131, GNorm = 0.7382, lr_0 = 9.9334e-04
Validation auc = 0.706205
Epoch 9427
Loss = 5.9561e-02, PNorm = 865.6585, GNorm = 2.7048, lr_0 = 9.9334e-04
Validation auc = 0.703947
Epoch 9428
Loss = 2.5658e-02, PNorm = 865.7059, GNorm = 1.1456, lr_0 = 9.9334e-04
Validation auc = 0.703084
Epoch 9429
Loss = 7.5952e-02, PNorm = 865.7457, GNorm = 3.5882, lr_0 = 9.9334e-04
Loss = 5.4438e-02, PNorm = 865.7863, GNorm = 1.1548, lr_0 = 9.9334e-04
Validation auc = 0.698758
Epoch 9430
Loss = 2.0581e-01, PNorm = 865.8412, GNorm = 0.6935, lr_0 = 9.9334e-04
Validation auc = 0.679624
Epoch 9431
Loss = 5.0798e-02, PNorm = 865.9026, GNorm = 0.8027, lr_0 = 9.9334e-04
Validation auc = 0.667726
Epoch 9432
Loss = 7.0875e-02, PNorm = 865.9999, GNorm = 1.0529, lr_0 = 9.9334e-04
Validation auc = 0.672301
Epoch 9433
Loss = 8.9487e-02, PNorm = 866.0827, GNorm = 2.5971, lr_0 = 9.9334e-04
Validation auc = 0.674526
Epoch 9434
Loss = 7.8846e-02, PNorm = 866.1668, GNorm = 6.7903, lr_0 = 9.9334e-04
Validation auc = 0.674755
Epoch 9435
Loss = 6.4480e-02, PNorm = 866.2444, GNorm = 2.7143, lr_0 = 9.9334e-04
Validation auc = 0.675340
Epoch 9436
Loss = 6.0582e-02, PNorm = 866.3037, GNorm = 1.5962, lr_0 = 9.9334e-04
Validation auc = 0.691091
Epoch 9437
Loss = 7.4341e-02, PNorm = 866.3958, GNorm = 5.8574, lr_0 = 9.9334e-04
Validation auc = 0.694650
Epoch 9438
Loss = 2.5536e-01, PNorm = 866.4845, GNorm = 2.0305, lr_0 = 9.9333e-04
Validation auc = 0.701274
Epoch 9439
Loss = 3.0210e-02, PNorm = 866.5785, GNorm = 1.3738, lr_0 = 9.9333e-04
Loss = 1.4005e-01, PNorm = 866.6620, GNorm = 0.7228, lr_0 = 9.9333e-04
Validation auc = 0.696517
Epoch 9440
Loss = 1.1832e-01, PNorm = 866.7489, GNorm = 3.6707, lr_0 = 9.9333e-04
Validation auc = 0.691639
Epoch 9441
Loss = 8.9204e-02, PNorm = 866.8413, GNorm = 1.9503, lr_0 = 9.9333e-04
Validation auc = 0.684397
Epoch 9442
Loss = 6.6934e-02, PNorm = 866.9074, GNorm = 4.2448, lr_0 = 9.9333e-04
Validation auc = 0.686844
Epoch 9443
Loss = 9.2699e-02, PNorm = 866.9629, GNorm = 5.2638, lr_0 = 9.9333e-04
Validation auc = 0.688057
Epoch 9444
Loss = 6.3694e-02, PNorm = 867.0104, GNorm = 6.6612, lr_0 = 9.9333e-04
Validation auc = 0.687426
Epoch 9445
Loss = 8.4205e-02, PNorm = 867.0557, GNorm = 1.7301, lr_0 = 9.9333e-04
Validation auc = 0.682616
Epoch 9446
Loss = 7.5852e-02, PNorm = 867.1096, GNorm = 1.0717, lr_0 = 9.9333e-04
Validation auc = 0.682677
Epoch 9447
Loss = 3.6122e-02, PNorm = 867.1651, GNorm = 1.9340, lr_0 = 9.9333e-04
Validation auc = 0.687050
Epoch 9448
Loss = 1.9125e-02, PNorm = 867.2128, GNorm = 0.7588, lr_0 = 9.9333e-04
Validation auc = 0.695131
Epoch 9449
Loss = 2.7533e-02, PNorm = 867.2522, GNorm = 2.4780, lr_0 = 9.9333e-04
Loss = 7.7890e-02, PNorm = 867.3074, GNorm = 2.9138, lr_0 = 9.9333e-04
Validation auc = 0.699482
Epoch 9450
Loss = 2.8257e-02, PNorm = 867.3553, GNorm = 2.2424, lr_0 = 9.9333e-04
Validation auc = 0.700211
Epoch 9451
Loss = 9.3719e-02, PNorm = 867.3948, GNorm = 2.8464, lr_0 = 9.9332e-04
Validation auc = 0.697508
Epoch 9452
Loss = 6.4790e-02, PNorm = 867.4420, GNorm = 4.3591, lr_0 = 9.9332e-04
Validation auc = 0.698309
Epoch 9453
Loss = 1.7616e-01, PNorm = 867.4902, GNorm = 6.2549, lr_0 = 9.9332e-04
Validation auc = 0.682561
Epoch 9454
Loss = 1.3405e-01, PNorm = 867.5520, GNorm = 2.5834, lr_0 = 9.9332e-04
Validation auc = 0.688354
Epoch 9455
Loss = 3.8579e-02, PNorm = 867.6097, GNorm = 1.1434, lr_0 = 9.9332e-04
Validation auc = 0.691715
Epoch 9456
Loss = 1.2098e-01, PNorm = 867.6676, GNorm = 7.7298, lr_0 = 9.9332e-04
Validation auc = 0.690445
Epoch 9457
Loss = 2.2559e-01, PNorm = 867.7248, GNorm = 0.9079, lr_0 = 9.9332e-04
Validation auc = 0.695254
Epoch 9458
Loss = 1.8878e-01, PNorm = 867.7793, GNorm = 12.1208, lr_0 = 9.9332e-04
Validation auc = 0.686642
Epoch 9459
Loss = 3.2691e-02, PNorm = 867.8299, GNorm = 2.0199, lr_0 = 9.9332e-04
Loss = 7.3667e-02, PNorm = 867.8759, GNorm = 1.4080, lr_0 = 9.9332e-04
Validation auc = 0.690821
Epoch 9460
Loss = 8.9555e-02, PNorm = 867.9187, GNorm = 1.0264, lr_0 = 9.9332e-04
Validation auc = 0.697095
Epoch 9461
Loss = 7.1264e-02, PNorm = 867.9622, GNorm = 1.3444, lr_0 = 9.9332e-04
Validation auc = 0.701499
Epoch 9462
Loss = 8.0194e-02, PNorm = 868.0029, GNorm = 5.0275, lr_0 = 9.9332e-04
Validation auc = 0.701572
Epoch 9463
Loss = 7.1550e-02, PNorm = 868.0673, GNorm = 0.7086, lr_0 = 9.9332e-04
Validation auc = 0.699798
Epoch 9464
Loss = 7.0971e-02, PNorm = 868.1246, GNorm = 2.0574, lr_0 = 9.9331e-04
Validation auc = 0.698996
Epoch 9465
Loss = 1.3131e-01, PNorm = 868.1916, GNorm = 4.5419, lr_0 = 9.9331e-04
Validation auc = 0.699524
Epoch 9466
Loss = 1.1631e-01, PNorm = 868.2751, GNorm = 8.6839, lr_0 = 9.9331e-04
Validation auc = 0.698654
Epoch 9467
Loss = 9.4267e-02, PNorm = 868.3492, GNorm = 1.8207, lr_0 = 9.9331e-04
Validation auc = 0.697750
Epoch 9468
Loss = 1.2251e-01, PNorm = 868.4132, GNorm = 1.9276, lr_0 = 9.9331e-04
Validation auc = 0.698600
Epoch 9469
Loss = 3.8893e-02, PNorm = 868.4637, GNorm = 1.0959, lr_0 = 9.9331e-04
Loss = 6.5096e-02, PNorm = 868.5050, GNorm = 1.7237, lr_0 = 9.9331e-04
Validation auc = 0.699855
Epoch 9470
Loss = 4.1756e-01, PNorm = 868.5757, GNorm = 0.8973, lr_0 = 9.9331e-04
Validation auc = 0.701149
Epoch 9471
Loss = 7.2394e-02, PNorm = 868.6593, GNorm = 7.0154, lr_0 = 9.9331e-04
Validation auc = 0.701892
Epoch 9472
Loss = 6.3300e-02, PNorm = 868.7210, GNorm = 1.6645, lr_0 = 9.9331e-04
Validation auc = 0.699801
Epoch 9473
Loss = 5.2805e-02, PNorm = 868.7687, GNorm = 2.7276, lr_0 = 9.9331e-04
Validation auc = 0.696421
Epoch 9474
Loss = 7.2843e-02, PNorm = 868.8097, GNorm = 5.0294, lr_0 = 9.9331e-04
Validation auc = 0.696964
Epoch 9475
Loss = 4.8461e-02, PNorm = 868.8532, GNorm = 2.5620, lr_0 = 9.9331e-04
Validation auc = 0.698493
Epoch 9476
Loss = 3.9701e-02, PNorm = 868.8902, GNorm = 1.9084, lr_0 = 9.9331e-04
Validation auc = 0.698122
Epoch 9477
Loss = 4.0448e-02, PNorm = 868.9232, GNorm = 3.1024, lr_0 = 9.9331e-04
Validation auc = 0.696745
Epoch 9478
Loss = 1.9928e-01, PNorm = 868.9549, GNorm = 8.6632, lr_0 = 9.9330e-04
Validation auc = 0.696089
Epoch 9479
Loss = 6.2020e-02, PNorm = 868.9890, GNorm = 1.5951, lr_0 = 9.9330e-04
Loss = 4.9897e-02, PNorm = 869.0217, GNorm = 0.2012, lr_0 = 9.9330e-04
Validation auc = 0.699897
Epoch 9480
Loss = 7.2791e-02, PNorm = 869.0595, GNorm = 1.1866, lr_0 = 9.9330e-04
Validation auc = 0.698765
Epoch 9481
Loss = 4.0061e-02, PNorm = 869.0994, GNorm = 1.1090, lr_0 = 9.9330e-04
Validation auc = 0.694220
Epoch 9482
Loss = 9.4975e-02, PNorm = 869.1345, GNorm = 3.5473, lr_0 = 9.9330e-04
Validation auc = 0.688731
Epoch 9483
Loss = 2.4679e-02, PNorm = 869.1777, GNorm = 0.6024, lr_0 = 9.9330e-04
Validation auc = 0.687113
Epoch 9484
Loss = 6.9743e-02, PNorm = 869.2107, GNorm = 3.8119, lr_0 = 9.9330e-04
Validation auc = 0.682385
Epoch 9485
Loss = 1.1139e-01, PNorm = 869.2534, GNorm = 3.6133, lr_0 = 9.9330e-04
Validation auc = 0.680533
Epoch 9486
Loss = 7.6199e-02, PNorm = 869.2939, GNorm = 1.3475, lr_0 = 9.9330e-04
Validation auc = 0.682101
Epoch 9487
Loss = 4.8222e-02, PNorm = 869.3328, GNorm = 4.5000, lr_0 = 9.9330e-04
Validation auc = 0.689789
Epoch 9488
Loss = 4.1929e-02, PNorm = 869.3685, GNorm = 2.0663, lr_0 = 9.9330e-04
Validation auc = 0.692688
Epoch 9489
Loss = 1.2632e-01, PNorm = 869.4004, GNorm = 4.3464, lr_0 = 9.9330e-04
Loss = 4.9906e-02, PNorm = 869.4238, GNorm = 0.3255, lr_0 = 9.9330e-04
Validation auc = 0.692672
Epoch 9490
Loss = 3.2570e-02, PNorm = 869.4470, GNorm = 0.3183, lr_0 = 9.9330e-04
Validation auc = 0.692130
Epoch 9491
Loss = 3.6633e-02, PNorm = 869.4727, GNorm = 0.8678, lr_0 = 9.9329e-04
Validation auc = 0.692730
Epoch 9492
Loss = 1.0518e-01, PNorm = 869.5117, GNorm = 5.0964, lr_0 = 9.9329e-04
Validation auc = 0.689768
Epoch 9493
Loss = 3.1131e-02, PNorm = 869.5558, GNorm = 1.5691, lr_0 = 9.9329e-04
Validation auc = 0.688177
Epoch 9494
Loss = 2.8111e-02, PNorm = 869.5948, GNorm = 1.2862, lr_0 = 9.9329e-04
Validation auc = 0.686918
Epoch 9495
Loss = 3.5487e-02, PNorm = 869.6257, GNorm = 1.3141, lr_0 = 9.9329e-04
Validation auc = 0.683748
Epoch 9496
Loss = 6.2343e-02, PNorm = 869.6553, GNorm = 1.2959, lr_0 = 9.9329e-04
Validation auc = 0.679928
Epoch 9497
Loss = 1.8621e-02, PNorm = 869.6843, GNorm = 1.0028, lr_0 = 9.9329e-04
Validation auc = 0.677858
Epoch 9498
Loss = 6.6590e-02, PNorm = 869.7121, GNorm = 2.8923, lr_0 = 9.9329e-04
Validation auc = 0.675244
Epoch 9499
Loss = 1.0359e-01, PNorm = 869.7396, GNorm = 3.8714, lr_0 = 9.9329e-04
Loss = 8.9160e-02, PNorm = 869.7708, GNorm = 1.4755, lr_0 = 9.9329e-04
Validation auc = 0.673252
Epoch 9500
Loss = 3.4406e-02, PNorm = 869.8053, GNorm = 1.4062, lr_0 = 9.9329e-04
Validation auc = 0.674739
Epoch 9501
Loss = 2.8147e-02, PNorm = 869.8319, GNorm = 1.7815, lr_0 = 9.9329e-04
Validation auc = 0.673372
Epoch 9502
Loss = 3.8070e-02, PNorm = 869.8608, GNorm = 0.8203, lr_0 = 9.9329e-04
Validation auc = 0.677125
Epoch 9503
Loss = 4.8499e-02, PNorm = 869.8923, GNorm = 0.2084, lr_0 = 9.9329e-04
Validation auc = 0.678934
Epoch 9504
Loss = 3.9326e-02, PNorm = 869.9182, GNorm = 0.5458, lr_0 = 9.9328e-04
Validation auc = 0.680247
Epoch 9505
Loss = 2.0529e-02, PNorm = 869.9422, GNorm = 0.8043, lr_0 = 9.9328e-04
Validation auc = 0.679444
Epoch 9506
Loss = 1.3930e-02, PNorm = 869.9579, GNorm = 0.8768, lr_0 = 9.9328e-04
Validation auc = 0.676682
Epoch 9507
Loss = 7.1724e-02, PNorm = 869.9783, GNorm = 0.4106, lr_0 = 9.9328e-04
Validation auc = 0.673443
Epoch 9508
Loss = 1.9564e-02, PNorm = 870.0034, GNorm = 0.3790, lr_0 = 9.9328e-04
Validation auc = 0.671474
Epoch 9509
Loss = 1.8014e-02, PNorm = 870.0275, GNorm = 0.4228, lr_0 = 9.9328e-04
Loss = 2.5808e-02, PNorm = 870.0463, GNorm = 3.0422, lr_0 = 9.9328e-04
Validation auc = 0.671173
Epoch 9510
Loss = 5.8710e-02, PNorm = 870.0712, GNorm = 2.1819, lr_0 = 9.9328e-04
Validation auc = 0.670573
Epoch 9511
Loss = 1.7102e-02, PNorm = 870.0976, GNorm = 0.6355, lr_0 = 9.9328e-04
Validation auc = 0.671259
Epoch 9512
Loss = 5.3077e-02, PNorm = 870.1207, GNorm = 0.3280, lr_0 = 9.9328e-04
Validation auc = 0.670944
Epoch 9513
Loss = 4.9110e-02, PNorm = 870.1481, GNorm = 2.4412, lr_0 = 9.9328e-04
Validation auc = 0.670911
Epoch 9514
Loss = 4.5587e-02, PNorm = 870.1782, GNorm = 6.6678, lr_0 = 9.9328e-04
Validation auc = 0.673662
Epoch 9515
Loss = 8.1381e-02, PNorm = 870.2075, GNorm = 1.4040, lr_0 = 9.9328e-04
Validation auc = 0.680405
Epoch 9516
Loss = 7.1819e-02, PNorm = 870.2339, GNorm = 0.1694, lr_0 = 9.9328e-04
Validation auc = 0.682771
Epoch 9517
Loss = 1.8673e-01, PNorm = 870.2624, GNorm = 0.2997, lr_0 = 9.9328e-04
Validation auc = 0.681260
Epoch 9518
Loss = 8.4317e-03, PNorm = 870.2914, GNorm = 1.2497, lr_0 = 9.9327e-04
Validation auc = 0.680004
Epoch 9519
Loss = 3.2091e-02, PNorm = 870.3178, GNorm = 1.5009, lr_0 = 9.9327e-04
Loss = 1.1796e-01, PNorm = 870.3594, GNorm = 4.1727, lr_0 = 9.9327e-04
Validation auc = 0.679185
Epoch 9520
Loss = 2.3608e-02, PNorm = 870.4027, GNorm = 0.1877, lr_0 = 9.9327e-04
Validation auc = 0.682933
Epoch 9521
Loss = 5.7502e-02, PNorm = 870.4348, GNorm = 3.1480, lr_0 = 9.9327e-04
Validation auc = 0.682206
Epoch 9522
Loss = 3.2685e-02, PNorm = 870.4596, GNorm = 0.7240, lr_0 = 9.9327e-04
Validation auc = 0.682562
Epoch 9523
Loss = 2.1381e-02, PNorm = 870.4855, GNorm = 0.3347, lr_0 = 9.9327e-04
Validation auc = 0.681073
Epoch 9524
Loss = 9.3812e-02, PNorm = 870.5112, GNorm = 2.6190, lr_0 = 9.9327e-04
Validation auc = 0.681523
Epoch 9525
Loss = 2.1074e-02, PNorm = 870.5361, GNorm = 1.2681, lr_0 = 9.9327e-04
Validation auc = 0.680059
Epoch 9526
Loss = 3.1065e-02, PNorm = 870.5560, GNorm = 0.2583, lr_0 = 9.9327e-04
Validation auc = 0.680411
Epoch 9527
Loss = 1.3377e-02, PNorm = 870.5727, GNorm = 0.5946, lr_0 = 9.9327e-04
Validation auc = 0.686360
Epoch 9528
Loss = 1.0094e-02, PNorm = 870.5948, GNorm = 0.1482, lr_0 = 9.9327e-04
Validation auc = 0.690048
Epoch 9529
Loss = 1.7038e-01, PNorm = 870.6224, GNorm = 5.3318, lr_0 = 9.9327e-04
Loss = 6.0004e-02, PNorm = 870.6508, GNorm = 4.6559, lr_0 = 9.9327e-04
Validation auc = 0.690404
Epoch 9530
Loss = 3.3787e-02, PNorm = 870.6847, GNorm = 0.2697, lr_0 = 9.9327e-04
Validation auc = 0.689815
Epoch 9531
Loss = 5.7188e-02, PNorm = 870.7142, GNorm = 3.1109, lr_0 = 9.9326e-04
Validation auc = 0.689451
Epoch 9532
Loss = 4.0831e-02, PNorm = 870.7449, GNorm = 27.6595, lr_0 = 9.9326e-04
Validation auc = 0.691111
Epoch 9533
Loss = 7.9827e-02, PNorm = 870.7892, GNorm = 2.6476, lr_0 = 9.9326e-04
Validation auc = 0.687618
Epoch 9534
Loss = 1.0473e-01, PNorm = 870.8334, GNorm = 2.0383, lr_0 = 9.9326e-04
Validation auc = 0.683667
Epoch 9535
Loss = 2.9021e-02, PNorm = 870.8973, GNorm = 1.1374, lr_0 = 9.9326e-04
Validation auc = 0.678914
Epoch 9536
Loss = 3.0757e-01, PNorm = 870.9496, GNorm = 11.3051, lr_0 = 9.9326e-04
Validation auc = 0.675435
Epoch 9537
Loss = 1.0316e-01, PNorm = 871.0110, GNorm = 6.0529, lr_0 = 9.9326e-04
Validation auc = 0.675907
Epoch 9538
Loss = 5.7670e-02, PNorm = 871.0639, GNorm = 1.9833, lr_0 = 9.9326e-04
Validation auc = 0.678033
Epoch 9539
Loss = 1.1220e-02, PNorm = 871.1038, GNorm = 0.2049, lr_0 = 9.9326e-04
Loss = 4.2231e-02, PNorm = 871.1423, GNorm = 1.6333, lr_0 = 9.9326e-04
Validation auc = 0.678809
Epoch 9540
Loss = 3.6974e-02, PNorm = 871.1728, GNorm = 2.7193, lr_0 = 9.9326e-04
Validation auc = 0.679848
Epoch 9541
Loss = 2.2670e-02, PNorm = 871.1969, GNorm = 0.2784, lr_0 = 9.9326e-04
Validation auc = 0.681119
Epoch 9542
Loss = 6.1812e-02, PNorm = 871.2210, GNorm = 0.3368, lr_0 = 9.9326e-04
Validation auc = 0.682371
Epoch 9543
Loss = 5.4304e-02, PNorm = 871.2579, GNorm = 5.2371, lr_0 = 9.9326e-04
Validation auc = 0.681342
Epoch 9544
Loss = 9.4660e-02, PNorm = 871.2953, GNorm = 0.8263, lr_0 = 9.9325e-04
Validation auc = 0.679736
Epoch 9545
Loss = 3.6027e-02, PNorm = 871.3291, GNorm = 1.0665, lr_0 = 9.9325e-04
Validation auc = 0.681739
Epoch 9546
Loss = 2.6723e-02, PNorm = 871.3663, GNorm = 0.8550, lr_0 = 9.9325e-04
Validation auc = 0.684783
Epoch 9547
Loss = 2.2083e-02, PNorm = 871.4049, GNorm = 1.9664, lr_0 = 9.9325e-04
Validation auc = 0.685529
Epoch 9548
Loss = 4.5431e-02, PNorm = 871.4318, GNorm = 1.4472, lr_0 = 9.9325e-04
Validation auc = 0.683064
Epoch 9549
Loss = 4.0355e-02, PNorm = 871.4581, GNorm = 3.0225, lr_0 = 9.9325e-04
Loss = 7.0255e-02, PNorm = 871.4924, GNorm = 8.6731, lr_0 = 9.9325e-04
Validation auc = 0.679401
Epoch 9550
Loss = 8.3802e-02, PNorm = 871.5360, GNorm = 1.8149, lr_0 = 9.9325e-04
Validation auc = 0.682094
Epoch 9551
Loss = 1.0175e-01, PNorm = 871.5852, GNorm = 7.7522, lr_0 = 9.9325e-04
Validation auc = 0.691275
Epoch 9552
Loss = 3.7516e-02, PNorm = 871.6478, GNorm = 2.4406, lr_0 = 9.9325e-04
Validation auc = 0.696242
Epoch 9553
Loss = 3.1551e-02, PNorm = 871.6925, GNorm = 1.9679, lr_0 = 9.9325e-04
Validation auc = 0.696629
Epoch 9554
Loss = 4.9682e-02, PNorm = 871.7228, GNorm = 0.6330, lr_0 = 9.9325e-04
Validation auc = 0.695977
Epoch 9555
Loss = 1.3114e-02, PNorm = 871.7503, GNorm = 0.1745, lr_0 = 9.9325e-04
Validation auc = 0.696993
Epoch 9556
Loss = 2.3161e-02, PNorm = 871.7704, GNorm = 0.4971, lr_0 = 9.9325e-04
Validation auc = 0.697980
Epoch 9557
Loss = 6.9301e-02, PNorm = 871.7906, GNorm = 2.0504, lr_0 = 9.9325e-04
Validation auc = 0.695797
Epoch 9558
Loss = 2.1873e-02, PNorm = 871.8146, GNorm = 0.4093, lr_0 = 9.9324e-04
Validation auc = 0.697505
Epoch 9559
Loss = 2.2649e-01, PNorm = 871.8414, GNorm = 5.0771, lr_0 = 9.9324e-04
Loss = 2.9553e-02, PNorm = 871.8672, GNorm = 1.1042, lr_0 = 9.9324e-04
Validation auc = 0.695827
Epoch 9560
Loss = 2.2544e-02, PNorm = 871.8869, GNorm = 0.4402, lr_0 = 9.9324e-04
Validation auc = 0.693582
Epoch 9561
Loss = 3.6986e-02, PNorm = 871.9069, GNorm = 0.7724, lr_0 = 9.9324e-04
Validation auc = 0.697517
Epoch 9562
Loss = 2.9615e-02, PNorm = 871.9289, GNorm = 0.9865, lr_0 = 9.9324e-04
Validation auc = 0.699228
Epoch 9563
Loss = 3.2995e-02, PNorm = 871.9534, GNorm = 4.1213, lr_0 = 9.9324e-04
Validation auc = 0.699130
Epoch 9564
Loss = 8.7963e-02, PNorm = 871.9774, GNorm = 0.3338, lr_0 = 9.9324e-04
Validation auc = 0.700746
Epoch 9565
Loss = 1.2621e-01, PNorm = 872.0018, GNorm = 0.2190, lr_0 = 9.9324e-04
Validation auc = 0.699666
Epoch 9566
Loss = 1.2837e-01, PNorm = 872.0354, GNorm = 0.4508, lr_0 = 9.9324e-04
Validation auc = 0.698487
Epoch 9567
Loss = 2.5999e-02, PNorm = 872.0724, GNorm = 1.1714, lr_0 = 9.9324e-04
Validation auc = 0.696905
Epoch 9568
Loss = 2.4640e-02, PNorm = 872.1081, GNorm = 2.8486, lr_0 = 9.9324e-04
Validation auc = 0.696289
Epoch 9569
Loss = 6.8788e-02, PNorm = 872.1463, GNorm = 1.7440, lr_0 = 9.9324e-04
Loss = 9.2742e-02, PNorm = 872.1888, GNorm = 2.2878, lr_0 = 9.9324e-04
Validation auc = 0.693418
Epoch 9570
Loss = 7.4137e-02, PNorm = 872.2304, GNorm = 4.4767, lr_0 = 9.9323e-04
Validation auc = 0.689561
Epoch 9571
Loss = 4.0338e-02, PNorm = 872.2782, GNorm = 1.6808, lr_0 = 9.9323e-04
Validation auc = 0.683569
Epoch 9572
Loss = 4.2873e-02, PNorm = 872.3729, GNorm = 0.7103, lr_0 = 9.9323e-04
Validation auc = 0.676400
Epoch 9573
Loss = 4.2306e-02, PNorm = 872.4553, GNorm = 2.0877, lr_0 = 9.9323e-04
Validation auc = 0.664014
Epoch 9574
Loss = 8.6464e-02, PNorm = 872.5097, GNorm = 4.2313, lr_0 = 9.9323e-04
Validation auc = 0.660562
Epoch 9575
Loss = 6.3642e-02, PNorm = 872.5530, GNorm = 8.1154, lr_0 = 9.9323e-04
Validation auc = 0.663998
Epoch 9576
Loss = 7.0907e-02, PNorm = 872.5892, GNorm = 0.5094, lr_0 = 9.9323e-04
Validation auc = 0.666584
Epoch 9577
Loss = 6.1214e-02, PNorm = 872.6210, GNorm = 9.3595, lr_0 = 9.9323e-04
Validation auc = 0.670414
Epoch 9578
Loss = 2.7422e-02, PNorm = 872.6477, GNorm = 0.3053, lr_0 = 9.9323e-04
Validation auc = 0.670489
Epoch 9579
Loss = 1.2475e-01, PNorm = 872.6782, GNorm = 3.1146, lr_0 = 9.9323e-04
Loss = 5.0347e-02, PNorm = 872.7163, GNorm = 3.5395, lr_0 = 9.9323e-04
Validation auc = 0.668033
Epoch 9580
Loss = 1.5916e-01, PNorm = 872.7463, GNorm = 3.2855, lr_0 = 9.9323e-04
Validation auc = 0.666479
Epoch 9581
Loss = 3.2929e-02, PNorm = 872.7857, GNorm = 1.2537, lr_0 = 9.9323e-04
Validation auc = 0.671399
Epoch 9582
Loss = 7.7516e-02, PNorm = 872.8208, GNorm = 2.3320, lr_0 = 9.9323e-04
Validation auc = 0.676194
Epoch 9583
Loss = 6.8119e-02, PNorm = 872.8622, GNorm = 3.2468, lr_0 = 9.9323e-04
Validation auc = 0.676906
Epoch 9584
Loss = 1.7219e-02, PNorm = 872.8993, GNorm = 2.1437, lr_0 = 9.9322e-04
Validation auc = 0.675938
Epoch 9585
Loss = 3.0489e-02, PNorm = 872.9259, GNorm = 3.7990, lr_0 = 9.9322e-04
Validation auc = 0.677618
Epoch 9586
Loss = 3.4203e-02, PNorm = 872.9503, GNorm = 0.1406, lr_0 = 9.9322e-04
Validation auc = 0.671141
Epoch 9587
Loss = 3.0190e-02, PNorm = 872.9799, GNorm = 0.9393, lr_0 = 9.9322e-04
Validation auc = 0.666870
Epoch 9588
Loss = 2.1841e-02, PNorm = 873.0020, GNorm = 0.2821, lr_0 = 9.9322e-04
Validation auc = 0.669267
Epoch 9589
Loss = 1.1763e-01, PNorm = 873.0167, GNorm = 2.3507, lr_0 = 9.9322e-04
Loss = 2.0072e-02, PNorm = 873.0342, GNorm = 0.2824, lr_0 = 9.9322e-04
Validation auc = 0.673924
Epoch 9590
Loss = 5.2110e-02, PNorm = 873.0518, GNorm = 0.5576, lr_0 = 9.9322e-04
Validation auc = 0.672426
Epoch 9591
Loss = 1.2587e-01, PNorm = 873.0747, GNorm = 1.5827, lr_0 = 9.9322e-04
Validation auc = 0.670280
Epoch 9592
Loss = 3.4620e-02, PNorm = 873.1057, GNorm = 1.6932, lr_0 = 9.9322e-04
Validation auc = 0.673530
Epoch 9593
Loss = 2.1948e-02, PNorm = 873.1304, GNorm = 0.1538, lr_0 = 9.9322e-04
Validation auc = 0.677209
Epoch 9594
Loss = 5.3525e-02, PNorm = 873.1485, GNorm = 1.2970, lr_0 = 9.9322e-04
Validation auc = 0.676112
Epoch 9595
Loss = 6.6931e-02, PNorm = 873.1726, GNorm = 1.4590, lr_0 = 9.9322e-04
Validation auc = 0.677122
Epoch 9596
Loss = 7.8462e-02, PNorm = 873.1998, GNorm = 4.6370, lr_0 = 9.9322e-04
Validation auc = 0.680306
Epoch 9597
Loss = 5.9655e-02, PNorm = 873.2294, GNorm = 0.8807, lr_0 = 9.9322e-04
Validation auc = 0.683267
Epoch 9598
Loss = 2.7411e-02, PNorm = 873.2561, GNorm = 1.6732, lr_0 = 9.9321e-04
Validation auc = 0.687314
Epoch 9599
Loss = 9.2035e-03, PNorm = 873.2829, GNorm = 0.4977, lr_0 = 9.9321e-04
Loss = 2.3063e-02, PNorm = 873.3064, GNorm = 1.8360, lr_0 = 9.9321e-04
Validation auc = 0.687659
Epoch 9600
Loss = 3.5292e-02, PNorm = 873.3299, GNorm = 1.9626, lr_0 = 9.9321e-04
Validation auc = 0.689181
Epoch 9601
Loss = 3.3147e-02, PNorm = 873.3568, GNorm = 5.4472, lr_0 = 9.9321e-04
Validation auc = 0.689392
Epoch 9602
Loss = 2.6800e-02, PNorm = 873.3828, GNorm = 0.1315, lr_0 = 9.9321e-04
Validation auc = 0.689954
Epoch 9603
Loss = 4.9552e-02, PNorm = 873.4009, GNorm = 1.2969, lr_0 = 9.9321e-04
Validation auc = 0.689147
Epoch 9604
Loss = 1.9227e-02, PNorm = 873.4197, GNorm = 0.9283, lr_0 = 9.9321e-04
Validation auc = 0.690833
Epoch 9605
Loss = 1.0704e-02, PNorm = 873.4402, GNorm = 1.2607, lr_0 = 9.9321e-04
Validation auc = 0.693779
Epoch 9606
Loss = 3.8798e-02, PNorm = 873.4651, GNorm = 0.1216, lr_0 = 9.9321e-04
Validation auc = 0.694694
Epoch 9607
Loss = 2.3794e-02, PNorm = 873.4922, GNorm = 0.8488, lr_0 = 9.9321e-04
Validation auc = 0.695423
Epoch 9608
Loss = 1.6100e-02, PNorm = 873.5177, GNorm = 0.9845, lr_0 = 9.9321e-04
Validation auc = 0.692680
Epoch 9609
Loss = 9.9588e-02, PNorm = 873.5413, GNorm = 3.3130, lr_0 = 9.9321e-04
Loss = 9.6736e-02, PNorm = 873.5665, GNorm = 8.1289, lr_0 = 9.9321e-04
Validation auc = 0.693724
Epoch 9610
Loss = 6.5075e-02, PNorm = 873.6014, GNorm = 3.0160, lr_0 = 9.9320e-04
Validation auc = 0.694369
Epoch 9611
Loss = 8.7721e-02, PNorm = 873.6415, GNorm = 1.4849, lr_0 = 9.9320e-04
Validation auc = 0.694694
Epoch 9612
Loss = 3.8098e-02, PNorm = 873.6764, GNorm = 0.3974, lr_0 = 9.9320e-04
Validation auc = 0.696065
Epoch 9613
Loss = 4.6945e-02, PNorm = 873.7087, GNorm = 4.9749, lr_0 = 9.9320e-04
Validation auc = 0.693315
Epoch 9614
Loss = 1.0135e-01, PNorm = 873.7529, GNorm = 0.6209, lr_0 = 9.9320e-04
Validation auc = 0.679379
Epoch 9615
Loss = 1.7198e-01, PNorm = 873.8083, GNorm = 3.6218, lr_0 = 9.9320e-04
Validation auc = 0.661986
Epoch 9616
Loss = 5.2171e-02, PNorm = 873.8631, GNorm = 0.5521, lr_0 = 9.9320e-04
Validation auc = 0.657999
Epoch 9617
Loss = 3.5720e-02, PNorm = 873.9069, GNorm = 0.4185, lr_0 = 9.9320e-04
Validation auc = 0.659368
Epoch 9618
Loss = 2.1815e-02, PNorm = 873.9338, GNorm = 0.2660, lr_0 = 9.9320e-04
Validation auc = 0.661410
Epoch 9619
Loss = 7.9570e-03, PNorm = 873.9537, GNorm = 0.2479, lr_0 = 9.9320e-04
Loss = 3.3624e-02, PNorm = 873.9737, GNorm = 1.7780, lr_0 = 9.9320e-04
Validation auc = 0.664000
Epoch 9620
Loss = 6.0756e-02, PNorm = 874.0005, GNorm = 0.7276, lr_0 = 9.9320e-04
Validation auc = 0.668070
Epoch 9621
Loss = 3.6034e-02, PNorm = 874.0289, GNorm = 1.9256, lr_0 = 9.9320e-04
Validation auc = 0.673484
Epoch 9622
Loss = 7.2866e-02, PNorm = 874.0568, GNorm = 1.8456, lr_0 = 9.9320e-04
Validation auc = 0.670887
Epoch 9623
Loss = 4.9957e-02, PNorm = 874.0950, GNorm = 4.1176, lr_0 = 9.9320e-04
Validation auc = 0.669902
Epoch 9624
Loss = 1.8018e-02, PNorm = 874.1296, GNorm = 1.3965, lr_0 = 9.9319e-04
Validation auc = 0.676022
Epoch 9625
Loss = 3.1933e-02, PNorm = 874.1559, GNorm = 0.3509, lr_0 = 9.9319e-04
Validation auc = 0.677918
Epoch 9626
Loss = 2.0873e-02, PNorm = 874.1752, GNorm = 0.6919, lr_0 = 9.9319e-04
Validation auc = 0.682304
Epoch 9627
Loss = 1.7837e-02, PNorm = 874.2001, GNorm = 0.3709, lr_0 = 9.9319e-04
Validation auc = 0.689616
Epoch 9628
Loss = 1.4738e-02, PNorm = 874.2377, GNorm = 1.1825, lr_0 = 9.9319e-04
Validation auc = 0.690863
Epoch 9629
Loss = 5.3104e-03, PNorm = 874.2773, GNorm = 0.1368, lr_0 = 9.9319e-04
Loss = 3.5102e-02, PNorm = 874.3095, GNorm = 2.2018, lr_0 = 9.9319e-04
Validation auc = 0.691991
Epoch 9630
Loss = 1.4893e-01, PNorm = 874.3414, GNorm = 1.1193, lr_0 = 9.9319e-04
Validation auc = 0.690845
Epoch 9631
Loss = 2.3030e-02, PNorm = 874.3763, GNorm = 2.1835, lr_0 = 9.9319e-04
Validation auc = 0.688135
Epoch 9632
Loss = 2.6479e-02, PNorm = 874.4036, GNorm = 1.0716, lr_0 = 9.9319e-04
Validation auc = 0.687150
Epoch 9633
Loss = 4.2909e-02, PNorm = 874.4287, GNorm = 2.1968, lr_0 = 9.9319e-04
Validation auc = 0.683756
Epoch 9634
Loss = 3.7114e-02, PNorm = 874.4571, GNorm = 0.4614, lr_0 = 9.9319e-04
Validation auc = 0.680809
Epoch 9635
Loss = 5.1517e-02, PNorm = 874.4841, GNorm = 4.5759, lr_0 = 9.9319e-04
Validation auc = 0.684033
Epoch 9636
Loss = 6.2409e-02, PNorm = 874.5129, GNorm = 5.3165, lr_0 = 9.9319e-04
Validation auc = 0.688611
Epoch 9637
Loss = 3.0940e-02, PNorm = 874.5378, GNorm = 1.0088, lr_0 = 9.9319e-04
Validation auc = 0.693066
Epoch 9638
Loss = 6.9692e-03, PNorm = 874.5598, GNorm = 0.3998, lr_0 = 9.9318e-04
Validation auc = 0.687975
Epoch 9639
Loss = 1.2864e-02, PNorm = 874.5836, GNorm = 0.9636, lr_0 = 9.9318e-04
Loss = 7.1340e-02, PNorm = 874.6100, GNorm = 3.2408, lr_0 = 9.9318e-04
Validation auc = 0.687467
Epoch 9640
Loss = 4.5959e-02, PNorm = 874.6395, GNorm = 7.1997, lr_0 = 9.9318e-04
Validation auc = 0.688567
Epoch 9641
Loss = 1.0094e+00, PNorm = 874.7807, GNorm = 2.6206, lr_0 = 9.9318e-04
Validation auc = 0.670724
Epoch 9642
Loss = 1.2182e-01, PNorm = 874.9953, GNorm = 11.8477, lr_0 = 9.9318e-04
Validation auc = 0.669387
Epoch 9643
Loss = 2.5213e-01, PNorm = 875.1513, GNorm = 30.1060, lr_0 = 9.9318e-04
Validation auc = 0.673717
Epoch 9644
Loss = 1.1129e-01, PNorm = 875.2744, GNorm = 1.5413, lr_0 = 9.9318e-04
Validation auc = 0.678787
Epoch 9645
Loss = 1.6419e-01, PNorm = 875.3781, GNorm = 17.5644, lr_0 = 9.9318e-04
Validation auc = 0.693655
Epoch 9646
Loss = 2.3259e-01, PNorm = 875.4761, GNorm = 4.1165, lr_0 = 9.9318e-04
Validation auc = 0.695924
Epoch 9647
Loss = 7.0645e-02, PNorm = 875.5700, GNorm = 3.0591, lr_0 = 9.9318e-04
Validation auc = 0.694468
Epoch 9648
Loss = 9.5265e-02, PNorm = 875.6383, GNorm = 5.1313, lr_0 = 9.9318e-04
Validation auc = 0.697466
Epoch 9649
Loss = 2.8299e-02, PNorm = 875.7352, GNorm = 1.7604, lr_0 = 9.9318e-04
Loss = 7.0737e-02, PNorm = 875.8276, GNorm = 1.4668, lr_0 = 9.9318e-04
Validation auc = 0.699875
Epoch 9650
Loss = 9.9897e-02, PNorm = 875.9037, GNorm = 3.1854, lr_0 = 9.9317e-04
Validation auc = 0.704776
Epoch 9651
Loss = 1.4961e-01, PNorm = 875.9671, GNorm = 2.2942, lr_0 = 9.9317e-04
Validation auc = 0.705297
Epoch 9652
Loss = 9.4282e-02, PNorm = 876.0334, GNorm = 1.6633, lr_0 = 9.9317e-04
Validation auc = 0.699935
Epoch 9653
Loss = 7.4236e-02, PNorm = 876.0931, GNorm = 3.9073, lr_0 = 9.9317e-04
Validation auc = 0.695732
Epoch 9654
Loss = 2.8064e-02, PNorm = 876.1428, GNorm = 0.5057, lr_0 = 9.9317e-04
Validation auc = 0.693791
Epoch 9655
Loss = 3.1841e-02, PNorm = 876.1835, GNorm = 2.5598, lr_0 = 9.9317e-04
Validation auc = 0.692143
Epoch 9656
Loss = 7.8750e-02, PNorm = 876.2193, GNorm = 5.4712, lr_0 = 9.9317e-04
Validation auc = 0.688799
Epoch 9657
Loss = 4.5685e-01, PNorm = 876.2695, GNorm = 2.5810, lr_0 = 9.9317e-04
Validation auc = 0.687372
Epoch 9658
Loss = 5.8494e-02, PNorm = 876.3505, GNorm = 1.6007, lr_0 = 9.9317e-04
Validation auc = 0.687153
Epoch 9659
Loss = 5.8307e-02, PNorm = 876.4158, GNorm = 4.0338, lr_0 = 9.9317e-04
Loss = 1.0170e-01, PNorm = 876.4761, GNorm = 0.4450, lr_0 = 9.9317e-04
Validation auc = 0.684241
Epoch 9660
Loss = 1.1738e-01, PNorm = 876.5251, GNorm = 2.0364, lr_0 = 9.9317e-04
Validation auc = 0.679971
Epoch 9661
Loss = 4.6916e-02, PNorm = 876.5746, GNorm = 0.9320, lr_0 = 9.9317e-04
Validation auc = 0.676871
Epoch 9662
Loss = 5.5213e-02, PNorm = 876.6108, GNorm = 2.9971, lr_0 = 9.9317e-04
Validation auc = 0.677286
Epoch 9663
Loss = 3.4265e-02, PNorm = 876.6355, GNorm = 1.0008, lr_0 = 9.9317e-04
Validation auc = 0.677662
Epoch 9664
Loss = 4.4099e-02, PNorm = 876.6620, GNorm = 2.1771, lr_0 = 9.9316e-04
Validation auc = 0.680941
Epoch 9665
Loss = 3.8689e-02, PNorm = 876.6947, GNorm = 1.0110, lr_0 = 9.9316e-04
Validation auc = 0.680183
Epoch 9666
Loss = 1.2460e-01, PNorm = 876.7351, GNorm = 2.4475, lr_0 = 9.9316e-04
Validation auc = 0.681651
Epoch 9667
Loss = 1.7118e-01, PNorm = 876.7987, GNorm = 0.9985, lr_0 = 9.9316e-04
Validation auc = 0.692157
Epoch 9668
Loss = 1.3917e-01, PNorm = 876.8613, GNorm = 4.3795, lr_0 = 9.9316e-04
Validation auc = 0.697531
Epoch 9669
Loss = 5.2821e-02, PNorm = 876.9148, GNorm = 1.3913, lr_0 = 9.9316e-04
Loss = 1.3488e-01, PNorm = 876.9554, GNorm = 23.5108, lr_0 = 9.9316e-04
Validation auc = 0.696949
Epoch 9670
Loss = 7.4001e-02, PNorm = 877.0153, GNorm = 6.4663, lr_0 = 9.9316e-04
Validation auc = 0.699468
Epoch 9671
Loss = 5.5664e-02, PNorm = 877.0682, GNorm = 4.2213, lr_0 = 9.9316e-04
Validation auc = 0.701191
Epoch 9672
Loss = 1.0228e-01, PNorm = 877.1213, GNorm = 4.4198, lr_0 = 9.9316e-04
Validation auc = 0.700192
Epoch 9673
Loss = 7.0969e-02, PNorm = 877.1743, GNorm = 3.6989, lr_0 = 9.9316e-04
Validation auc = 0.695623
Epoch 9674
Loss = 4.6661e-02, PNorm = 877.2152, GNorm = 1.7505, lr_0 = 9.9316e-04
Validation auc = 0.695181
Epoch 9675
Loss = 2.5124e-02, PNorm = 877.2499, GNorm = 1.2201, lr_0 = 9.9316e-04
Validation auc = 0.694626
Epoch 9676
Loss = 9.5479e-02, PNorm = 877.2759, GNorm = 6.3897, lr_0 = 9.9316e-04
Validation auc = 0.696132
Epoch 9677
Loss = 7.7241e-02, PNorm = 877.3089, GNorm = 7.1359, lr_0 = 9.9315e-04
Validation auc = 0.698304
Epoch 9678
Loss = 7.8586e-02, PNorm = 877.3464, GNorm = 1.1973, lr_0 = 9.9315e-04
Validation auc = 0.697213
Epoch 9679
Loss = 1.9003e-02, PNorm = 877.3810, GNorm = 1.0703, lr_0 = 9.9315e-04
Loss = 5.7242e-02, PNorm = 877.4181, GNorm = 1.2361, lr_0 = 9.9315e-04
Validation auc = 0.693525
Epoch 9680
Loss = 9.1742e-02, PNorm = 877.4535, GNorm = 0.3315, lr_0 = 9.9315e-04
Validation auc = 0.700457
Epoch 9681
Loss = 3.9464e-02, PNorm = 877.4930, GNorm = 0.8823, lr_0 = 9.9315e-04
Validation auc = 0.703463
Epoch 9682
Loss = 3.8017e-02, PNorm = 877.5283, GNorm = 2.3239, lr_0 = 9.9315e-04
Validation auc = 0.703589
Epoch 9683
Loss = 1.8738e-02, PNorm = 877.5631, GNorm = 0.5399, lr_0 = 9.9315e-04
Validation auc = 0.702179
Epoch 9684
Loss = 1.0990e-01, PNorm = 877.5903, GNorm = 2.3442, lr_0 = 9.9315e-04
Validation auc = 0.698519
Epoch 9685
Loss = 2.7793e-02, PNorm = 877.6157, GNorm = 0.2864, lr_0 = 9.9315e-04
Validation auc = 0.691944
Epoch 9686
Loss = 3.8401e-02, PNorm = 877.6559, GNorm = 1.5259, lr_0 = 9.9315e-04
Validation auc = 0.685909
Epoch 9687
Loss = 1.1551e-01, PNorm = 877.6923, GNorm = 0.9319, lr_0 = 9.9315e-04
Validation auc = 0.682290
Epoch 9688
Loss = 6.3871e-02, PNorm = 877.7268, GNorm = 1.1650, lr_0 = 9.9315e-04
Validation auc = 0.680863
Epoch 9689
Loss = 1.3232e-02, PNorm = 877.7599, GNorm = 1.2038, lr_0 = 9.9315e-04
Loss = 3.3437e-02, PNorm = 877.7838, GNorm = 0.5615, lr_0 = 9.9315e-04
Validation auc = 0.680157
Epoch 9690
Loss = 4.4773e-02, PNorm = 877.8099, GNorm = 1.5195, lr_0 = 9.9314e-04
Validation auc = 0.681729
Epoch 9691
Loss = 6.8538e-02, PNorm = 877.8378, GNorm = 1.0269, lr_0 = 9.9314e-04
Validation auc = 0.684162
Epoch 9692
Loss = 2.2531e-02, PNorm = 877.8649, GNorm = 0.2012, lr_0 = 9.9314e-04
Validation auc = 0.686465
Epoch 9693
Loss = 5.7019e-02, PNorm = 877.8946, GNorm = 0.5844, lr_0 = 9.9314e-04
Validation auc = 0.690287
Epoch 9694
Loss = 4.3515e-02, PNorm = 877.9238, GNorm = 4.0292, lr_0 = 9.9314e-04
Validation auc = 0.692580
Epoch 9695
Loss = 1.4111e-01, PNorm = 877.9507, GNorm = 46.2432, lr_0 = 9.9314e-04
Validation auc = 0.686570
Epoch 9696
Loss = 1.7294e-02, PNorm = 877.9938, GNorm = 0.6735, lr_0 = 9.9314e-04
Validation auc = 0.682914
Epoch 9697
Loss = 6.1866e-02, PNorm = 878.0253, GNorm = 1.2885, lr_0 = 9.9314e-04
Validation auc = 0.681650
Epoch 9698
Loss = 1.3264e-01, PNorm = 878.0480, GNorm = 6.8187, lr_0 = 9.9314e-04
Validation auc = 0.681557
Epoch 9699
Loss = 1.0677e-02, PNorm = 878.0702, GNorm = 0.4082, lr_0 = 9.9314e-04
Loss = 3.9997e-02, PNorm = 878.0946, GNorm = 0.7329, lr_0 = 9.9314e-04
Validation auc = 0.681760
Epoch 9700
Loss = 7.6877e-02, PNorm = 878.1157, GNorm = 2.1958, lr_0 = 9.9314e-04
Validation auc = 0.686023
Epoch 9701
Loss = 3.8973e-02, PNorm = 878.1407, GNorm = 2.0657, lr_0 = 9.9314e-04
Validation auc = 0.690695
Epoch 9702
Loss = 5.5471e-02, PNorm = 878.1643, GNorm = 0.8870, lr_0 = 9.9314e-04
Validation auc = 0.690172
Epoch 9703
Loss = 1.0062e-01, PNorm = 878.1868, GNorm = 2.3426, lr_0 = 9.9314e-04
Validation auc = 0.694110
Epoch 9704
Loss = 5.4545e-02, PNorm = 878.2126, GNorm = 5.1972, lr_0 = 9.9313e-04
Validation auc = 0.696884
Epoch 9705
Loss = 5.0342e-02, PNorm = 878.2385, GNorm = 1.3641, lr_0 = 9.9313e-04
Validation auc = 0.691444
Epoch 9706
Loss = 6.9056e-02, PNorm = 878.2745, GNorm = 8.5302, lr_0 = 9.9313e-04
Validation auc = 0.689282
Epoch 9707
Loss = 3.7538e-02, PNorm = 878.3141, GNorm = 3.3332, lr_0 = 9.9313e-04
Validation auc = 0.691509
Epoch 9708
Loss = 3.9533e-02, PNorm = 878.3493, GNorm = 3.5560, lr_0 = 9.9313e-04
Validation auc = 0.696351
Epoch 9709
Loss = 1.3028e-01, PNorm = 878.3856, GNorm = 8.5116, lr_0 = 9.9313e-04
Loss = 2.8151e-02, PNorm = 878.4192, GNorm = 0.7754, lr_0 = 9.9313e-04
Validation auc = 0.698868
Epoch 9710
Loss = 3.6465e-02, PNorm = 878.4520, GNorm = 1.4962, lr_0 = 9.9313e-04
Validation auc = 0.703145
Epoch 9711
Loss = 4.1451e-02, PNorm = 878.4780, GNorm = 0.8030, lr_0 = 9.9313e-04
Validation auc = 0.702840
Epoch 9712
Loss = 5.7211e-02, PNorm = 878.5032, GNorm = 0.2695, lr_0 = 9.9313e-04
Validation auc = 0.698291
Epoch 9713
Loss = 3.3738e-02, PNorm = 878.5328, GNorm = 0.3145, lr_0 = 9.9313e-04
Validation auc = 0.701704
Epoch 9714
Loss = 8.6017e-02, PNorm = 878.5567, GNorm = 10.7279, lr_0 = 9.9313e-04
Validation auc = 0.703509
Epoch 9715
Loss = 1.0630e-01, PNorm = 878.5850, GNorm = 6.3179, lr_0 = 9.9313e-04
Validation auc = 0.703510
Epoch 9716
Loss = 4.7473e-02, PNorm = 878.6157, GNorm = 4.1287, lr_0 = 9.9313e-04
Validation auc = 0.705489
Epoch 9717
Loss = 3.1829e-02, PNorm = 878.6385, GNorm = 0.6343, lr_0 = 9.9312e-04
Validation auc = 0.706706
Epoch 9718
Loss = 7.0955e-02, PNorm = 878.6598, GNorm = 3.7211, lr_0 = 9.9312e-04
Validation auc = 0.710575
Epoch 9719
Loss = 3.6988e-02, PNorm = 878.6870, GNorm = 3.9401, lr_0 = 9.9312e-04
Loss = 2.7268e-02, PNorm = 878.7072, GNorm = 2.4335, lr_0 = 9.9312e-04
Validation auc = 0.711884
Epoch 9720
Loss = 3.2744e-02, PNorm = 878.7266, GNorm = 0.7798, lr_0 = 9.9312e-04
Validation auc = 0.713512
Epoch 9721
Loss = 4.8341e-02, PNorm = 878.7505, GNorm = 0.3334, lr_0 = 9.9312e-04
Validation auc = 0.714505
Epoch 9722
Loss = 3.3162e-02, PNorm = 878.7773, GNorm = 0.4615, lr_0 = 9.9312e-04
Validation auc = 0.713264
Epoch 9723
Loss = 3.2081e-02, PNorm = 878.8025, GNorm = 2.1899, lr_0 = 9.9312e-04
Validation auc = 0.712766
Epoch 9724
Loss = 7.8110e-02, PNorm = 878.8298, GNorm = 1.1638, lr_0 = 9.9312e-04
Validation auc = 0.713381
Epoch 9725
Loss = 2.0005e-02, PNorm = 878.8568, GNorm = 0.8154, lr_0 = 9.9312e-04
Validation auc = 0.714744
Epoch 9726
Loss = 3.8297e-02, PNorm = 878.8778, GNorm = 4.8120, lr_0 = 9.9312e-04
Validation auc = 0.711769
Epoch 9727
Loss = 5.9092e-03, PNorm = 878.8998, GNorm = 0.1198, lr_0 = 9.9312e-04
Validation auc = 0.710306
Epoch 9728
Loss = 2.6667e-02, PNorm = 878.9199, GNorm = 0.8811, lr_0 = 9.9312e-04
Validation auc = 0.711917
Epoch 9729
Loss = 2.4535e-03, PNorm = 878.9377, GNorm = 0.2191, lr_0 = 9.9312e-04
Loss = 6.2085e-02, PNorm = 878.9535, GNorm = 1.6676, lr_0 = 9.9312e-04
Validation auc = 0.709540
Epoch 9730
Loss = 4.3038e-02, PNorm = 878.9807, GNorm = 2.6581, lr_0 = 9.9311e-04
Validation auc = 0.699314
Epoch 9731
Loss = 2.0920e-02, PNorm = 879.0055, GNorm = 1.4107, lr_0 = 9.9311e-04
Validation auc = 0.699767
Epoch 9732
Loss = 3.4933e-02, PNorm = 879.0323, GNorm = 1.8539, lr_0 = 9.9311e-04
Validation auc = 0.700061
Epoch 9733
Loss = 3.0446e-02, PNorm = 879.0621, GNorm = 2.3870, lr_0 = 9.9311e-04
Validation auc = 0.707610
Epoch 9734
Loss = 7.0879e-02, PNorm = 879.0940, GNorm = 3.4123, lr_0 = 9.9311e-04
Validation auc = 0.706069
Epoch 9735
Loss = 4.1800e-02, PNorm = 879.1412, GNorm = 1.1609, lr_0 = 9.9311e-04
Validation auc = 0.705129
Epoch 9736
Loss = 1.7039e-01, PNorm = 879.1794, GNorm = 9.1811, lr_0 = 9.9311e-04
Validation auc = 0.702004
Epoch 9737
Loss = 5.6540e-02, PNorm = 879.2439, GNorm = 0.8719, lr_0 = 9.9311e-04
Validation auc = 0.698270
Epoch 9738
Loss = 1.6722e-02, PNorm = 879.3086, GNorm = 0.6432, lr_0 = 9.9311e-04
Validation auc = 0.693656
Epoch 9739
Loss = 1.3180e-02, PNorm = 879.3704, GNorm = 0.6110, lr_0 = 9.9311e-04
Loss = 5.7345e-02, PNorm = 879.4177, GNorm = 1.4804, lr_0 = 9.9311e-04
Validation auc = 0.692052
Epoch 9740
Loss = 7.4439e-02, PNorm = 879.4557, GNorm = 1.0591, lr_0 = 9.9311e-04
Validation auc = 0.695739
Epoch 9741
Loss = 4.8668e-02, PNorm = 879.5026, GNorm = 1.3154, lr_0 = 9.9311e-04
Validation auc = 0.708691
Epoch 9742
Loss = 3.8702e-02, PNorm = 879.5478, GNorm = 1.9737, lr_0 = 9.9311e-04
Validation auc = 0.715747
Epoch 9743
Loss = 4.9087e-02, PNorm = 879.5806, GNorm = 1.7685, lr_0 = 9.9311e-04
Validation auc = 0.715763
Epoch 9744
Loss = 1.0280e-01, PNorm = 879.6081, GNorm = 7.1193, lr_0 = 9.9310e-04
Validation auc = 0.711292
Epoch 9745
Loss = 6.6814e-02, PNorm = 879.6482, GNorm = 4.8257, lr_0 = 9.9310e-04
Validation auc = 0.704476
Epoch 9746
Loss = 9.1679e-02, PNorm = 879.6988, GNorm = 1.1431, lr_0 = 9.9310e-04
Validation auc = 0.699727
Epoch 9747
Loss = 5.5640e-02, PNorm = 879.7509, GNorm = 1.6142, lr_0 = 9.9310e-04
Validation auc = 0.700123
Epoch 9748
Loss = 4.6829e-02, PNorm = 879.8001, GNorm = 0.9267, lr_0 = 9.9310e-04
Validation auc = 0.699867
Epoch 9749
Loss = 8.9620e-02, PNorm = 879.8413, GNorm = 2.4174, lr_0 = 9.9310e-04
Loss = 5.3575e-02, PNorm = 879.8729, GNorm = 2.9061, lr_0 = 9.9310e-04
Validation auc = 0.698744
Epoch 9750
Loss = 3.3148e-02, PNorm = 879.9042, GNorm = 0.3965, lr_0 = 9.9310e-04
Validation auc = 0.697630
Epoch 9751
Loss = 3.4868e-02, PNorm = 879.9365, GNorm = 2.6947, lr_0 = 9.9310e-04
Validation auc = 0.698542
Epoch 9752
Loss = 1.9242e-02, PNorm = 879.9743, GNorm = 0.3037, lr_0 = 9.9310e-04
Validation auc = 0.699574
Epoch 9753
Loss = 3.5440e-02, PNorm = 880.0020, GNorm = 2.3322, lr_0 = 9.9310e-04
Validation auc = 0.699410
Epoch 9754
Loss = 3.8223e-02, PNorm = 880.0272, GNorm = 2.7311, lr_0 = 9.9310e-04
Validation auc = 0.701422
Epoch 9755
Loss = 2.2757e-02, PNorm = 880.0516, GNorm = 1.2982, lr_0 = 9.9310e-04
Validation auc = 0.701379
Epoch 9756
Loss = 3.0680e-01, PNorm = 880.0793, GNorm = 1.6215, lr_0 = 9.9310e-04
Validation auc = 0.700344
Epoch 9757
Loss = 3.5253e-02, PNorm = 880.1319, GNorm = 0.4033, lr_0 = 9.9309e-04
Validation auc = 0.693903
Epoch 9758
Loss = 3.6099e-02, PNorm = 880.1769, GNorm = 0.7378, lr_0 = 9.9309e-04
Validation auc = 0.687643
Epoch 9759
Loss = 4.8043e-02, PNorm = 880.2201, GNorm = 3.9959, lr_0 = 9.9309e-04
Loss = 3.7932e-02, PNorm = 880.2568, GNorm = 0.7042, lr_0 = 9.9309e-04
Validation auc = 0.687917
Epoch 9760
Loss = 5.3111e-02, PNorm = 880.2840, GNorm = 2.7462, lr_0 = 9.9309e-04
Validation auc = 0.688283
Epoch 9761
Loss = 6.8789e-02, PNorm = 880.3095, GNorm = 7.7859, lr_0 = 9.9309e-04
Validation auc = 0.688613
Epoch 9762
Loss = 4.5519e-02, PNorm = 880.3350, GNorm = 4.6398, lr_0 = 9.9309e-04
Validation auc = 0.689876
Epoch 9763
Loss = 6.9246e-02, PNorm = 880.3629, GNorm = 1.1286, lr_0 = 9.9309e-04
Validation auc = 0.690120
Epoch 9764
Loss = 4.0864e-02, PNorm = 880.3935, GNorm = 1.1274, lr_0 = 9.9309e-04
Validation auc = 0.691881
Epoch 9765
Loss = 5.5213e-02, PNorm = 880.4225, GNorm = 0.3591, lr_0 = 9.9309e-04
Validation auc = 0.693600
Epoch 9766
Loss = 6.7358e-02, PNorm = 880.4570, GNorm = 2.6219, lr_0 = 9.9309e-04
Validation auc = 0.691475
Epoch 9767
Loss = 9.2381e-02, PNorm = 880.4821, GNorm = 2.8125, lr_0 = 9.9309e-04
Validation auc = 0.690423
Epoch 9768
Loss = 2.8379e-02, PNorm = 880.5116, GNorm = 0.5210, lr_0 = 9.9309e-04
Validation auc = 0.689417
Epoch 9769
Loss = 7.0161e-03, PNorm = 880.5466, GNorm = 0.3857, lr_0 = 9.9309e-04
Loss = 2.7931e-02, PNorm = 880.5772, GNorm = 1.2375, lr_0 = 9.9309e-04
Validation auc = 0.688650
Epoch 9770
Loss = 3.9489e-02, PNorm = 880.6042, GNorm = 1.6905, lr_0 = 9.9308e-04
Validation auc = 0.690284
Epoch 9771
Loss = 5.6570e-02, PNorm = 880.6390, GNorm = 0.5477, lr_0 = 9.9308e-04
Validation auc = 0.683319
Epoch 9772
Loss = 1.5756e-02, PNorm = 880.6698, GNorm = 1.6847, lr_0 = 9.9308e-04
Validation auc = 0.679502
Epoch 9773
Loss = 6.1068e-02, PNorm = 880.6974, GNorm = 0.2990, lr_0 = 9.9308e-04
Validation auc = 0.681710
Epoch 9774
Loss = 5.1560e-02, PNorm = 880.7226, GNorm = 2.5299, lr_0 = 9.9308e-04
Validation auc = 0.682495
Epoch 9775
Loss = 8.5165e-02, PNorm = 880.7480, GNorm = 0.5506, lr_0 = 9.9308e-04
Validation auc = 0.680596
Epoch 9776
Loss = 4.1621e-02, PNorm = 880.7758, GNorm = 3.9408, lr_0 = 9.9308e-04
Validation auc = 0.678659
Epoch 9777
Loss = 6.0047e-02, PNorm = 880.8035, GNorm = 3.3463, lr_0 = 9.9308e-04
Validation auc = 0.679740
Epoch 9778
Loss = 5.2985e-03, PNorm = 880.8342, GNorm = 0.5017, lr_0 = 9.9308e-04
Validation auc = 0.679206
Epoch 9779
Loss = 1.2771e-01, PNorm = 880.8646, GNorm = 6.3895, lr_0 = 9.9308e-04
Loss = 5.3768e-02, PNorm = 880.8948, GNorm = 1.2138, lr_0 = 9.9308e-04
Validation auc = 0.679850
Epoch 9780
Loss = 4.7984e-02, PNorm = 880.9169, GNorm = 0.7332, lr_0 = 9.9308e-04
Validation auc = 0.680708
Epoch 9781
Loss = 4.1441e-02, PNorm = 880.9367, GNorm = 0.4095, lr_0 = 9.9308e-04
Validation auc = 0.680317
Epoch 9782
Loss = 1.7541e-02, PNorm = 880.9539, GNorm = 0.6397, lr_0 = 9.9308e-04
Validation auc = 0.679305
Epoch 9783
Loss = 2.9452e-02, PNorm = 880.9699, GNorm = 0.5012, lr_0 = 9.9307e-04
Validation auc = 0.678535
Epoch 9784
Loss = 1.9716e-02, PNorm = 880.9863, GNorm = 0.7388, lr_0 = 9.9307e-04
Validation auc = 0.679923
Epoch 9785
Loss = 4.4235e-02, PNorm = 881.0021, GNorm = 1.0505, lr_0 = 9.9307e-04
Validation auc = 0.681522
Epoch 9786
Loss = 1.3644e-02, PNorm = 881.0190, GNorm = 2.9260, lr_0 = 9.9307e-04
Validation auc = 0.686534
Epoch 9787
Loss = 1.1211e-02, PNorm = 881.0367, GNorm = 0.9313, lr_0 = 9.9307e-04
Validation auc = 0.692951
Epoch 9788
Loss = 1.6700e-01, PNorm = 881.0559, GNorm = 8.3406, lr_0 = 9.9307e-04
Validation auc = 0.693661
Epoch 9789
Loss = 2.2194e-02, PNorm = 881.0789, GNorm = 1.5633, lr_0 = 9.9307e-04
Loss = 2.7731e-02, PNorm = 881.1040, GNorm = 1.0847, lr_0 = 9.9307e-04
Validation auc = 0.691259
Epoch 9790
Loss = 3.9596e-02, PNorm = 881.1288, GNorm = 1.7094, lr_0 = 9.9307e-04
Validation auc = 0.690767
Epoch 9791
Loss = 7.0501e-02, PNorm = 881.1555, GNorm = 2.7219, lr_0 = 9.9307e-04
Validation auc = 0.692548
Epoch 9792
Loss = 2.9631e-02, PNorm = 881.1844, GNorm = 0.4277, lr_0 = 9.9307e-04
Validation auc = 0.695406
Epoch 9793
Loss = 4.0640e-02, PNorm = 881.2147, GNorm = 1.0858, lr_0 = 9.9307e-04
Validation auc = 0.699410
Epoch 9794
Loss = 3.2787e-02, PNorm = 881.2458, GNorm = 0.3446, lr_0 = 9.9307e-04
Validation auc = 0.701588
Epoch 9795
Loss = 1.3938e-02, PNorm = 881.2723, GNorm = 0.3462, lr_0 = 9.9307e-04
Validation auc = 0.702882
Epoch 9796
Loss = 4.0463e-02, PNorm = 881.2943, GNorm = 0.5907, lr_0 = 9.9307e-04
Validation auc = 0.701270
Epoch 9797
Loss = 1.9196e-02, PNorm = 881.3134, GNorm = 0.2694, lr_0 = 9.9306e-04
Validation auc = 0.699961
Epoch 9798
Loss = 6.1654e-02, PNorm = 881.3287, GNorm = 6.5026, lr_0 = 9.9306e-04
Validation auc = 0.697788
Epoch 9799
Loss = 1.8505e-02, PNorm = 881.3565, GNorm = 1.4058, lr_0 = 9.9306e-04
Loss = 4.9864e-02, PNorm = 881.3914, GNorm = 0.7288, lr_0 = 9.9306e-04
Validation auc = 0.692431
Epoch 9800
Loss = 4.6586e-02, PNorm = 881.4169, GNorm = 2.1984, lr_0 = 9.9306e-04
Validation auc = 0.689787
Epoch 9801
Loss = 5.7944e-02, PNorm = 881.4461, GNorm = 1.0607, lr_0 = 9.9306e-04
Validation auc = 0.692617
Epoch 9802
Loss = 4.6581e-02, PNorm = 881.4745, GNorm = 0.4268, lr_0 = 9.9306e-04
Validation auc = 0.696399
Epoch 9803
Loss = 4.2166e-02, PNorm = 881.4968, GNorm = 0.3628, lr_0 = 9.9306e-04
Validation auc = 0.697098
Epoch 9804
Loss = 2.7358e-02, PNorm = 881.5148, GNorm = 4.0328, lr_0 = 9.9306e-04
Validation auc = 0.696538
Epoch 9805
Loss = 2.0019e-02, PNorm = 881.5306, GNorm = 0.5605, lr_0 = 9.9306e-04
Validation auc = 0.692156
Epoch 9806
Loss = 2.6765e-02, PNorm = 881.5466, GNorm = 0.5252, lr_0 = 9.9306e-04
Validation auc = 0.690821
Epoch 9807
Loss = 1.4982e-02, PNorm = 881.5669, GNorm = 1.1012, lr_0 = 9.9306e-04
Validation auc = 0.692366
Epoch 9808
Loss = 4.3077e-03, PNorm = 881.5834, GNorm = 0.5539, lr_0 = 9.9306e-04
Validation auc = 0.694574
Epoch 9809
Loss = 4.4166e-02, PNorm = 881.5975, GNorm = 1.0036, lr_0 = 9.9306e-04
Loss = 3.1966e-02, PNorm = 881.6158, GNorm = 0.2770, lr_0 = 9.9306e-04
Validation auc = 0.696480
Epoch 9810
Loss = 1.1597e-01, PNorm = 881.6538, GNorm = 11.0714, lr_0 = 9.9305e-04
Validation auc = 0.697678
Epoch 9811
Loss = 3.2689e-02, PNorm = 881.6877, GNorm = 1.1857, lr_0 = 9.9305e-04
Validation auc = 0.698369
Epoch 9812
Loss = 3.6617e-02, PNorm = 881.7114, GNorm = 3.3335, lr_0 = 9.9305e-04
Validation auc = 0.699571
Epoch 9813
Loss = 2.4132e-02, PNorm = 881.7347, GNorm = 1.2396, lr_0 = 9.9305e-04
Validation auc = 0.696716
Epoch 9814
Loss = 6.1830e-02, PNorm = 881.7580, GNorm = 0.4227, lr_0 = 9.9305e-04
Validation auc = 0.692190
Epoch 9815
Loss = 3.4702e-02, PNorm = 881.7804, GNorm = 5.1126, lr_0 = 9.9305e-04
Validation auc = 0.688796
Epoch 9816
Loss = 2.2799e-02, PNorm = 881.8100, GNorm = 0.1676, lr_0 = 9.9305e-04
Validation auc = 0.685494
Epoch 9817
Loss = 4.6784e-02, PNorm = 881.8431, GNorm = 0.9072, lr_0 = 9.9305e-04
Validation auc = 0.681219
Epoch 9818
Loss = 2.5202e-02, PNorm = 881.8771, GNorm = 0.4620, lr_0 = 9.9305e-04
Validation auc = 0.675132
Epoch 9819
Loss = 1.3406e-02, PNorm = 881.9033, GNorm = 0.5308, lr_0 = 9.9305e-04
Loss = 6.0250e-02, PNorm = 881.9240, GNorm = 0.3300, lr_0 = 9.9305e-04
Validation auc = 0.672295
Epoch 9820
Loss = 2.0706e-02, PNorm = 881.9447, GNorm = 0.4986, lr_0 = 9.9305e-04
Validation auc = 0.671416
Epoch 9821
Loss = 3.9486e-02, PNorm = 881.9718, GNorm = 0.5700, lr_0 = 9.9305e-04
Validation auc = 0.673199
Epoch 9822
Loss = 2.9396e-02, PNorm = 881.9928, GNorm = 2.3037, lr_0 = 9.9305e-04
Validation auc = 0.675135
Epoch 9823
Loss = 2.7560e-02, PNorm = 882.0092, GNorm = 2.7395, lr_0 = 9.9304e-04
Validation auc = 0.676707
Epoch 9824
Loss = 1.6781e-02, PNorm = 882.0279, GNorm = 0.2686, lr_0 = 9.9304e-04
Validation auc = 0.677777
Epoch 9825
Loss = 4.5976e-02, PNorm = 882.0483, GNorm = 0.7297, lr_0 = 9.9304e-04
Validation auc = 0.682414
Epoch 9826
Loss = 2.8253e-02, PNorm = 882.0726, GNorm = 3.4586, lr_0 = 9.9304e-04
Validation auc = 0.682819
Epoch 9827
Loss = 1.1212e-02, PNorm = 882.0915, GNorm = 1.5260, lr_0 = 9.9304e-04
Validation auc = 0.683565
Epoch 9828
Loss = 5.0574e-02, PNorm = 882.1140, GNorm = 4.4946, lr_0 = 9.9304e-04
Validation auc = 0.682644
Epoch 9829
Loss = 8.0232e-02, PNorm = 882.1401, GNorm = 3.9360, lr_0 = 9.9304e-04
Loss = 5.7629e-02, PNorm = 882.1629, GNorm = 2.6675, lr_0 = 9.9304e-04
Validation auc = 0.679237
Epoch 9830
Loss = 1.0856e-02, PNorm = 882.1862, GNorm = 0.3566, lr_0 = 9.9304e-04
Validation auc = 0.673138
Epoch 9831
Loss = 5.6306e-02, PNorm = 882.2043, GNorm = 1.4398, lr_0 = 9.9304e-04
Validation auc = 0.674041
Epoch 9832
Loss = 4.7389e-02, PNorm = 882.2222, GNorm = 5.5345, lr_0 = 9.9304e-04
Validation auc = 0.672854
Epoch 9833
Loss = 9.6567e-03, PNorm = 882.2450, GNorm = 1.1732, lr_0 = 9.9304e-04
Validation auc = 0.673702
Epoch 9834
Loss = 6.7136e-02, PNorm = 882.2643, GNorm = 0.6757, lr_0 = 9.9304e-04
Validation auc = 0.672006
Epoch 9835
Loss = 1.7603e-02, PNorm = 882.2832, GNorm = 2.1475, lr_0 = 9.9304e-04
Validation auc = 0.672167
Epoch 9836
Loss = 7.1962e-02, PNorm = 882.3039, GNorm = 4.5127, lr_0 = 9.9304e-04
Validation auc = 0.668691
Epoch 9837
Loss = 9.9615e-02, PNorm = 882.3275, GNorm = 1.6400, lr_0 = 9.9303e-04
Validation auc = 0.665535
Epoch 9838
Loss = 5.5120e-02, PNorm = 882.3520, GNorm = 0.5018, lr_0 = 9.9303e-04
Validation auc = 0.669297
Epoch 9839
Loss = 1.9427e-02, PNorm = 882.3766, GNorm = 1.3241, lr_0 = 9.9303e-04
Loss = 2.7247e-02, PNorm = 882.3984, GNorm = 1.4540, lr_0 = 9.9303e-04
Validation auc = 0.671630
Epoch 9840
Loss = 4.8944e-02, PNorm = 882.4273, GNorm = 0.2782, lr_0 = 9.9303e-04
Validation auc = 0.678918
Epoch 9841
Loss = 3.2363e-02, PNorm = 882.4593, GNorm = 0.8941, lr_0 = 9.9303e-04
Validation auc = 0.688834
Epoch 9842
Loss = 3.9978e-02, PNorm = 882.4883, GNorm = 1.6172, lr_0 = 9.9303e-04
Validation auc = 0.693124
Epoch 9843
Loss = 3.7823e-02, PNorm = 882.5256, GNorm = 1.3639, lr_0 = 9.9303e-04
Validation auc = 0.691006
Epoch 9844
Loss = 7.7854e-02, PNorm = 882.5546, GNorm = 5.9733, lr_0 = 9.9303e-04
Validation auc = 0.683956
Epoch 9845
Loss = 6.2650e-02, PNorm = 882.5875, GNorm = 0.9516, lr_0 = 9.9303e-04
Validation auc = 0.675578
Epoch 9846
Loss = 2.0243e-02, PNorm = 882.6192, GNorm = 1.1100, lr_0 = 9.9303e-04
Validation auc = 0.673866
Epoch 9847
Loss = 5.4539e-02, PNorm = 882.6479, GNorm = 6.9861, lr_0 = 9.9303e-04
Validation auc = 0.671130
Epoch 9848
Loss = 3.2357e-02, PNorm = 882.6789, GNorm = 1.1744, lr_0 = 9.9303e-04
Validation auc = 0.669634
Epoch 9849
Loss = 6.2516e-02, PNorm = 882.7074, GNorm = 2.6792, lr_0 = 9.9303e-04
Loss = 2.5759e-02, PNorm = 882.7331, GNorm = 0.4035, lr_0 = 9.9303e-04
Validation auc = 0.671594
Epoch 9850
Loss = 3.3523e-02, PNorm = 882.7633, GNorm = 0.6227, lr_0 = 9.9302e-04
Validation auc = 0.675653
Epoch 9851
Loss = 4.6303e-02, PNorm = 882.7930, GNorm = 0.1338, lr_0 = 9.9302e-04
Validation auc = 0.677601
Epoch 9852
Loss = 3.4992e-02, PNorm = 882.8158, GNorm = 0.2123, lr_0 = 9.9302e-04
Validation auc = 0.677297
Epoch 9853
Loss = 5.2576e-02, PNorm = 882.8317, GNorm = 1.3676, lr_0 = 9.9302e-04
Validation auc = 0.673435
Epoch 9854
Loss = 3.0055e-02, PNorm = 882.8534, GNorm = 2.7669, lr_0 = 9.9302e-04
Validation auc = 0.671360
Epoch 9855
Loss = 2.1526e-02, PNorm = 882.8793, GNorm = 0.3719, lr_0 = 9.9302e-04
Validation auc = 0.669229
Epoch 9856
Loss = 5.0292e-02, PNorm = 882.9005, GNorm = 0.4053, lr_0 = 9.9302e-04
Validation auc = 0.668427
Epoch 9857
Loss = 1.0201e-02, PNorm = 882.9224, GNorm = 0.3811, lr_0 = 9.9302e-04
Validation auc = 0.673458
Epoch 9858
Loss = 4.5073e-02, PNorm = 882.9441, GNorm = 3.6953, lr_0 = 9.9302e-04
Validation auc = 0.675974
Epoch 9859
Loss = 6.7411e-03, PNorm = 882.9647, GNorm = 0.4171, lr_0 = 9.9302e-04
Loss = 3.1542e-02, PNorm = 882.9885, GNorm = 0.8444, lr_0 = 9.9302e-04
Validation auc = 0.676178
Epoch 9860
Loss = 6.2138e-02, PNorm = 883.0143, GNorm = 1.0220, lr_0 = 9.9302e-04
Validation auc = 0.677246
Epoch 9861
Loss = 3.7244e-02, PNorm = 883.0413, GNorm = 1.1542, lr_0 = 9.9302e-04
Validation auc = 0.679356
Epoch 9862
Loss = 3.2202e-02, PNorm = 883.0660, GNorm = 1.3994, lr_0 = 9.9302e-04
Validation auc = 0.679333
Epoch 9863
Loss = 5.7801e-02, PNorm = 883.0844, GNorm = 0.1306, lr_0 = 9.9301e-04
Validation auc = 0.678001
Epoch 9864
Loss = 1.4639e-02, PNorm = 883.1017, GNorm = 0.1768, lr_0 = 9.9301e-04
Validation auc = 0.676199
Epoch 9865
Loss = 3.5396e-02, PNorm = 883.1211, GNorm = 6.7092, lr_0 = 9.9301e-04
Validation auc = 0.680450
Epoch 9866
Loss = 2.9046e-02, PNorm = 883.1542, GNorm = 0.7911, lr_0 = 9.9301e-04
Validation auc = 0.682139
Epoch 9867
Loss = 2.3438e-02, PNorm = 883.1862, GNorm = 5.9050, lr_0 = 9.9301e-04
Validation auc = 0.683468
Epoch 9868
Loss = 1.6093e-02, PNorm = 883.2124, GNorm = 1.7649, lr_0 = 9.9301e-04
Validation auc = 0.679791
Epoch 9869
Loss = 3.9068e-02, PNorm = 883.2376, GNorm = 1.4985, lr_0 = 9.9301e-04
Loss = 1.9704e-02, PNorm = 883.2634, GNorm = 0.4035, lr_0 = 9.9301e-04
Validation auc = 0.680591
Epoch 9870
Loss = 3.1451e-02, PNorm = 883.2840, GNorm = 5.6484, lr_0 = 9.9301e-04
Validation auc = 0.680631
Epoch 9871
Loss = 5.9480e-02, PNorm = 883.3136, GNorm = 0.2477, lr_0 = 9.9301e-04
Validation auc = 0.678057
Epoch 9872
Loss = 1.5446e-02, PNorm = 883.3471, GNorm = 0.1792, lr_0 = 9.9301e-04
Validation auc = 0.676592
Epoch 9873
Loss = 4.0559e-02, PNorm = 883.3689, GNorm = 2.4576, lr_0 = 9.9301e-04
Validation auc = 0.674903
Epoch 9874
Loss = 3.1804e-02, PNorm = 883.3893, GNorm = 0.4700, lr_0 = 9.9301e-04
Validation auc = 0.675724
Epoch 9875
Loss = 8.4785e-03, PNorm = 883.4104, GNorm = 0.2030, lr_0 = 9.9301e-04
Validation auc = 0.678460
Epoch 9876
Loss = 1.2956e-02, PNorm = 883.4292, GNorm = 0.7522, lr_0 = 9.9301e-04
Validation auc = 0.680641
Epoch 9877
Loss = 1.3300e-02, PNorm = 883.4453, GNorm = 0.3918, lr_0 = 9.9300e-04
Validation auc = 0.680788
Epoch 9878
Loss = 3.1401e-02, PNorm = 883.4580, GNorm = 1.5860, lr_0 = 9.9300e-04
Validation auc = 0.682389
Epoch 9879
Loss = 4.6740e-03, PNorm = 883.4727, GNorm = 0.2839, lr_0 = 9.9300e-04
Loss = 1.9494e-02, PNorm = 883.4866, GNorm = 0.1815, lr_0 = 9.9300e-04
Validation auc = 0.684089
Epoch 9880
Loss = 2.3041e-02, PNorm = 883.4999, GNorm = 0.3053, lr_0 = 9.9300e-04
Validation auc = 0.684675
Epoch 9881
Loss = 4.5944e-02, PNorm = 883.5196, GNorm = 1.6408, lr_0 = 9.9300e-04
Validation auc = 0.687708
Epoch 9882
Loss = 2.4641e-02, PNorm = 883.5370, GNorm = 7.0697, lr_0 = 9.9300e-04
Validation auc = 0.692009
Epoch 9883
Loss = 4.5589e-02, PNorm = 883.5584, GNorm = 1.3077, lr_0 = 9.9300e-04
Validation auc = 0.694393
Epoch 9884
Loss = 8.9412e-02, PNorm = 883.5793, GNorm = 10.8869, lr_0 = 9.9300e-04
Validation auc = 0.694530
Epoch 9885
Loss = 3.8025e-02, PNorm = 883.6142, GNorm = 0.7248, lr_0 = 9.9300e-04
Validation auc = 0.695615
Epoch 9886
Loss = 6.9197e-02, PNorm = 883.6419, GNorm = 1.5468, lr_0 = 9.9300e-04
Validation auc = 0.694921
Epoch 9887
Loss = 3.8006e-02, PNorm = 883.6622, GNorm = 3.8505, lr_0 = 9.9300e-04
Validation auc = 0.693339
Epoch 9888
Loss = 6.9470e-03, PNorm = 883.6793, GNorm = 0.7097, lr_0 = 9.9300e-04
Validation auc = 0.690137
Epoch 9889
Loss = 4.5046e-03, PNorm = 883.7080, GNorm = 0.4982, lr_0 = 9.9300e-04
Loss = 2.5921e-02, PNorm = 883.7380, GNorm = 1.7311, lr_0 = 9.9299e-04
Validation auc = 0.686049
Epoch 9890
Loss = 3.1598e-02, PNorm = 883.7619, GNorm = 0.9228, lr_0 = 9.9299e-04
Validation auc = 0.682984
Epoch 9891
Loss = 8.3063e-02, PNorm = 883.7824, GNorm = 5.7176, lr_0 = 9.9299e-04
Validation auc = 0.681669
Epoch 9892
Loss = 6.9769e-02, PNorm = 883.8136, GNorm = 0.4036, lr_0 = 9.9299e-04
Validation auc = 0.676087
Epoch 9893
Loss = 4.9825e-02, PNorm = 883.8477, GNorm = 1.5519, lr_0 = 9.9299e-04
Validation auc = 0.682597
Epoch 9894
Loss = 2.5038e-02, PNorm = 883.8797, GNorm = 2.2309, lr_0 = 9.9299e-04
Validation auc = 0.691114
Epoch 9895
Loss = 5.3402e-02, PNorm = 883.9093, GNorm = 2.4525, lr_0 = 9.9299e-04
Validation auc = 0.693911
Epoch 9896
Loss = 6.3146e-02, PNorm = 883.9409, GNorm = 2.6096, lr_0 = 9.9299e-04
Validation auc = 0.694371
Epoch 9897
Loss = 1.1561e-02, PNorm = 883.9683, GNorm = 0.8357, lr_0 = 9.9299e-04
Validation auc = 0.695968
Epoch 9898
Loss = 1.5715e-02, PNorm = 883.9923, GNorm = 2.5737, lr_0 = 9.9299e-04
Validation auc = 0.693839
Epoch 9899
Loss = 6.9523e-03, PNorm = 884.0089, GNorm = 0.3609, lr_0 = 9.9299e-04
Loss = 2.7965e-02, PNorm = 884.0239, GNorm = 0.5084, lr_0 = 9.9299e-04
Validation auc = 0.691377
Epoch 9900
Loss = 3.0793e-02, PNorm = 884.0419, GNorm = 0.2623, lr_0 = 9.9299e-04
Validation auc = 0.690202
Epoch 9901
Loss = 4.6618e-02, PNorm = 884.0647, GNorm = 0.6148, lr_0 = 9.9299e-04
Validation auc = 0.690555
Epoch 9902
Loss = 2.8826e-02, PNorm = 884.0909, GNorm = 0.2781, lr_0 = 9.9299e-04
Validation auc = 0.690946
Epoch 9903
Loss = 2.0187e-02, PNorm = 884.1117, GNorm = 0.2346, lr_0 = 9.9298e-04
Validation auc = 0.697433
Epoch 9904
Loss = 3.5445e-02, PNorm = 884.1330, GNorm = 1.3283, lr_0 = 9.9298e-04
Validation auc = 0.703844
Epoch 9905
Loss = 6.6156e-02, PNorm = 884.1585, GNorm = 3.1704, lr_0 = 9.9298e-04
Validation auc = 0.705630
Epoch 9906
Loss = 8.4420e-02, PNorm = 884.1965, GNorm = 0.4195, lr_0 = 9.9298e-04
Validation auc = 0.705176
Epoch 9907
Loss = 4.5366e-02, PNorm = 884.2451, GNorm = 0.3385, lr_0 = 9.9298e-04
Validation auc = 0.695880
Epoch 9908
Loss = 2.5190e-02, PNorm = 884.3041, GNorm = 1.6476, lr_0 = 9.9298e-04
Validation auc = 0.693924
Epoch 9909
Loss = 6.7109e-01, PNorm = 884.3507, GNorm = 19.5815, lr_0 = 9.9298e-04
Loss = 9.1695e-02, PNorm = 884.4092, GNorm = 3.2619, lr_0 = 9.9298e-04
Validation auc = 0.703843
Epoch 9910
Loss = 3.3690e-02, PNorm = 884.4581, GNorm = 1.4004, lr_0 = 9.9298e-04
Validation auc = 0.711697
Epoch 9911
Loss = 4.1421e-02, PNorm = 884.4941, GNorm = 1.0910, lr_0 = 9.9298e-04
Validation auc = 0.714930
Epoch 9912
Loss = 4.1830e-02, PNorm = 884.5253, GNorm = 0.3930, lr_0 = 9.9298e-04
Validation auc = 0.710161
Epoch 9913
Loss = 9.9642e-03, PNorm = 884.5529, GNorm = 0.3439, lr_0 = 9.9298e-04
Validation auc = 0.707504
Epoch 9914
Loss = 1.1686e-02, PNorm = 884.5714, GNorm = 0.2622, lr_0 = 9.9298e-04
Validation auc = 0.704771
Epoch 9915
Loss = 3.9103e-02, PNorm = 884.5914, GNorm = 5.7334, lr_0 = 9.9298e-04
Validation auc = 0.704587
Epoch 9916
Loss = 4.6616e-02, PNorm = 884.6157, GNorm = 0.2798, lr_0 = 9.9298e-04
Validation auc = 0.703887
Epoch 9917
Loss = 3.0604e-02, PNorm = 884.6384, GNorm = 1.2725, lr_0 = 9.9297e-04
Validation auc = 0.702628
Epoch 9918
Loss = 9.4770e-03, PNorm = 884.6542, GNorm = 0.6389, lr_0 = 9.9297e-04
Validation auc = 0.701348
Epoch 9919
Loss = 2.4313e-03, PNorm = 884.6731, GNorm = 0.4862, lr_0 = 9.9297e-04
Loss = 1.7707e-02, PNorm = 884.6893, GNorm = 1.8389, lr_0 = 9.9297e-04
Validation auc = 0.699444
Epoch 9920
Loss = 4.8287e-02, PNorm = 884.7108, GNorm = 0.1212, lr_0 = 9.9297e-04
Validation auc = 0.701840
Epoch 9921
Loss = 2.4858e-02, PNorm = 884.7408, GNorm = 1.7934, lr_0 = 9.9297e-04
Validation auc = 0.698757
Epoch 9922
Loss = 2.5498e-02, PNorm = 884.7705, GNorm = 0.5801, lr_0 = 9.9297e-04
Validation auc = 0.701166
Epoch 9923
Loss = 2.9261e-02, PNorm = 884.7965, GNorm = 0.1438, lr_0 = 9.9297e-04
Validation auc = 0.700328
Epoch 9924
Loss = 3.7709e-02, PNorm = 884.8161, GNorm = 1.7051, lr_0 = 9.9297e-04
Validation auc = 0.697564
Epoch 9925
Loss = 2.4866e-02, PNorm = 884.8360, GNorm = 0.2504, lr_0 = 9.9297e-04
Validation auc = 0.695938
Epoch 9926
Loss = 1.7974e-02, PNorm = 884.8550, GNorm = 0.3836, lr_0 = 9.9297e-04
Validation auc = 0.697788
Epoch 9927
Loss = 5.1230e-03, PNorm = 884.8720, GNorm = 0.0780, lr_0 = 9.9297e-04
Validation auc = 0.698668
Epoch 9928
Loss = 1.2818e-01, PNorm = 884.8962, GNorm = 4.9898, lr_0 = 9.9297e-04
Validation auc = 0.696773
Epoch 9929
Loss = 1.6287e-02, PNorm = 884.9353, GNorm = 1.1932, lr_0 = 9.9297e-04
Loss = 5.5567e-02, PNorm = 884.9715, GNorm = 0.4786, lr_0 = 9.9296e-04
Validation auc = 0.694995
Epoch 9930
Loss = 5.1903e-02, PNorm = 885.0111, GNorm = 0.3785, lr_0 = 9.9296e-04
Validation auc = 0.693346
Epoch 9931
Loss = 4.7994e-02, PNorm = 885.0509, GNorm = 0.6185, lr_0 = 9.9296e-04
Validation auc = 0.689364
Epoch 9932
Loss = 5.6409e-02, PNorm = 885.0862, GNorm = 1.8647, lr_0 = 9.9296e-04
Validation auc = 0.678479
Epoch 9933
Loss = 5.7288e-02, PNorm = 885.1204, GNorm = 1.4684, lr_0 = 9.9296e-04
Validation auc = 0.672391
Epoch 9934
Loss = 5.4547e-02, PNorm = 885.1526, GNorm = 11.1985, lr_0 = 9.9296e-04
Validation auc = 0.669427
Epoch 9935
Loss = 7.4613e-02, PNorm = 885.2187, GNorm = 3.1512, lr_0 = 9.9296e-04
Validation auc = 0.673098
Epoch 9936
Loss = 4.1616e-02, PNorm = 885.2752, GNorm = 2.6603, lr_0 = 9.9296e-04
Validation auc = 0.677617
Epoch 9937
Loss = 9.1859e-02, PNorm = 885.3266, GNorm = 2.7929, lr_0 = 9.9296e-04
Validation auc = 0.683097
Epoch 9938
Loss = 8.1753e-02, PNorm = 885.3832, GNorm = 2.5278, lr_0 = 9.9296e-04
Validation auc = 0.689863
Epoch 9939
Loss = 9.6332e-02, PNorm = 885.4294, GNorm = 6.1697, lr_0 = 9.9296e-04
Loss = 8.7081e-02, PNorm = 885.4989, GNorm = 1.9558, lr_0 = 9.9296e-04
Validation auc = 0.690411
Epoch 9940
Loss = 8.6506e-02, PNorm = 885.5654, GNorm = 3.0840, lr_0 = 9.9296e-04
Validation auc = 0.686259
Epoch 9941
Loss = 4.2663e-02, PNorm = 885.6151, GNorm = 1.6163, lr_0 = 9.9296e-04
Validation auc = 0.686573
Epoch 9942
Loss = 4.7157e-02, PNorm = 885.6559, GNorm = 2.8482, lr_0 = 9.9296e-04
Validation auc = 0.690692
Epoch 9943
Loss = 5.2779e-02, PNorm = 885.7319, GNorm = 3.3131, lr_0 = 9.9295e-04
Validation auc = 0.693800
Epoch 9944
Loss = 9.2502e-02, PNorm = 885.7956, GNorm = 6.9812, lr_0 = 9.9295e-04
Validation auc = 0.683739
Epoch 9945
Loss = 6.2885e-02, PNorm = 885.8585, GNorm = 3.7130, lr_0 = 9.9295e-04
Validation auc = 0.679810
Epoch 9946
Loss = 9.8890e-02, PNorm = 885.9146, GNorm = 3.1480, lr_0 = 9.9295e-04
Validation auc = 0.685998
Epoch 9947
Loss = 1.3866e-01, PNorm = 885.9654, GNorm = 7.5619, lr_0 = 9.9295e-04
Validation auc = 0.687217
Epoch 9948
Loss = 2.2383e-02, PNorm = 886.0148, GNorm = 0.5718, lr_0 = 9.9295e-04
Validation auc = 0.686194
Epoch 9949
Loss = 1.5146e-01, PNorm = 886.0637, GNorm = 11.8592, lr_0 = 9.9295e-04
Loss = 5.1039e-02, PNorm = 886.1084, GNorm = 4.2007, lr_0 = 9.9295e-04
Validation auc = 0.684251
Epoch 9950
Loss = 5.3160e-02, PNorm = 886.1505, GNorm = 2.4423, lr_0 = 9.9295e-04
Validation auc = 0.682624
Epoch 9951
Loss = 5.2307e-02, PNorm = 886.1995, GNorm = 1.5072, lr_0 = 9.9295e-04
Validation auc = 0.688336
Epoch 9952
Loss = 3.3543e-02, PNorm = 886.2396, GNorm = 1.8274, lr_0 = 9.9295e-04
Validation auc = 0.690745
Epoch 9953
Loss = 5.6461e-02, PNorm = 886.2743, GNorm = 2.8976, lr_0 = 9.9295e-04
Validation auc = 0.692773
Epoch 9954
Loss = 2.5036e-02, PNorm = 886.3092, GNorm = 1.2240, lr_0 = 9.9295e-04
Validation auc = 0.692835
Epoch 9955
Loss = 4.4590e-02, PNorm = 886.3381, GNorm = 4.0310, lr_0 = 9.9295e-04
Validation auc = 0.692695
Epoch 9956
Loss = 2.8840e-02, PNorm = 886.3697, GNorm = 0.3313, lr_0 = 9.9295e-04
Validation auc = 0.688948
Epoch 9957
Loss = 1.0773e-01, PNorm = 886.4014, GNorm = 14.6024, lr_0 = 9.9294e-04
Validation auc = 0.688875
Epoch 9958
Loss = 6.1065e-02, PNorm = 886.4490, GNorm = 5.0417, lr_0 = 9.9294e-04
Validation auc = 0.690078
Epoch 9959
Loss = 9.4031e-02, PNorm = 886.4960, GNorm = 2.8913, lr_0 = 9.9294e-04
Loss = 2.2972e-02, PNorm = 886.5322, GNorm = 0.3081, lr_0 = 9.9294e-04
Validation auc = 0.690516
Epoch 9960
Loss = 5.4137e-02, PNorm = 886.5651, GNorm = 2.0097, lr_0 = 9.9294e-04
Validation auc = 0.687825
Epoch 9961
Loss = 2.4245e-02, PNorm = 886.5946, GNorm = 4.2059, lr_0 = 9.9294e-04
Validation auc = 0.691437
Epoch 9962
Loss = 5.3398e-02, PNorm = 886.6265, GNorm = 5.0731, lr_0 = 9.9294e-04
Validation auc = 0.696487
Epoch 9963
Loss = 1.6234e-02, PNorm = 886.6688, GNorm = 3.7435, lr_0 = 9.9294e-04
Validation auc = 0.693637
Epoch 9964
Loss = 3.3779e-02, PNorm = 886.7092, GNorm = 1.5088, lr_0 = 9.9294e-04
Validation auc = 0.695682
Epoch 9965
Loss = 7.4693e-02, PNorm = 886.7421, GNorm = 2.2156, lr_0 = 9.9294e-04
Validation auc = 0.699606
Epoch 9966
Loss = 4.5071e-02, PNorm = 886.7753, GNorm = 0.4952, lr_0 = 9.9294e-04
Validation auc = 0.702073
Epoch 9967
Loss = 1.4074e-02, PNorm = 886.8045, GNorm = 2.3390, lr_0 = 9.9294e-04
Validation auc = 0.701065
Epoch 9968
Loss = 1.6233e-02, PNorm = 886.8265, GNorm = 0.5625, lr_0 = 9.9294e-04
Validation auc = 0.700722
Epoch 9969
Loss = 1.1470e-02, PNorm = 886.8470, GNorm = 0.7386, lr_0 = 9.9294e-04
Loss = 9.1344e-02, PNorm = 886.8639, GNorm = 0.9340, lr_0 = 9.9293e-04
Validation auc = 0.702874
Epoch 9970
Loss = 4.2919e-02, PNorm = 886.8880, GNorm = 2.7313, lr_0 = 9.9293e-04
Validation auc = 0.701470
Epoch 9971
Loss = 3.3209e-02, PNorm = 886.9211, GNorm = 1.9167, lr_0 = 9.9293e-04
Validation auc = 0.700239
Epoch 9972
Loss = 6.1466e-02, PNorm = 886.9561, GNorm = 2.8198, lr_0 = 9.9293e-04
Validation auc = 0.699540
Epoch 9973
Loss = 2.6441e-02, PNorm = 886.9881, GNorm = 2.6457, lr_0 = 9.9293e-04
Validation auc = 0.701503
Epoch 9974
Loss = 2.1047e-02, PNorm = 887.0134, GNorm = 0.7466, lr_0 = 9.9293e-04
Validation auc = 0.698759
Epoch 9975
Loss = 1.6307e-02, PNorm = 887.0417, GNorm = 0.7907, lr_0 = 9.9293e-04
Validation auc = 0.696430
Epoch 9976
Loss = 5.3600e-02, PNorm = 887.0695, GNorm = 2.9848, lr_0 = 9.9293e-04
Validation auc = 0.696301
Epoch 9977
Loss = 5.9188e-02, PNorm = 887.0986, GNorm = 0.8464, lr_0 = 9.9293e-04
Validation auc = 0.693193
Epoch 9978
Loss = 8.1187e-02, PNorm = 887.1327, GNorm = 6.6316, lr_0 = 9.9293e-04
Validation auc = 0.693013
Epoch 9979
Loss = 1.1333e-02, PNorm = 887.1717, GNorm = 0.7539, lr_0 = 9.9293e-04
Loss = 4.4835e-02, PNorm = 887.2007, GNorm = 4.7379, lr_0 = 9.9293e-04
Validation auc = 0.698386
Epoch 9980
Loss = 7.9818e-02, PNorm = 887.2293, GNorm = 1.3220, lr_0 = 9.9293e-04
Validation auc = 0.703345
Epoch 9981
Loss = 3.9509e-02, PNorm = 887.2614, GNorm = 4.8798, lr_0 = 9.9293e-04
Validation auc = 0.706437
Epoch 9982
Loss = 1.9907e-02, PNorm = 887.2864, GNorm = 0.9279, lr_0 = 9.9293e-04
Validation auc = 0.707619
Epoch 9983
Loss = 4.6266e-02, PNorm = 887.3055, GNorm = 7.1543, lr_0 = 9.9292e-04
Validation auc = 0.708855
Epoch 9984
Loss = 4.1655e-02, PNorm = 887.3302, GNorm = 2.0059, lr_0 = 9.9292e-04
Validation auc = 0.704002
Epoch 9985
Loss = 7.7410e-01, PNorm = 887.4097, GNorm = 1.0818, lr_0 = 9.9292e-04
Validation auc = 0.702991
Epoch 9986
Loss = 6.5577e-02, PNorm = 887.5314, GNorm = 1.9499, lr_0 = 9.9292e-04
Validation auc = 0.703577
Epoch 9987
Loss = 6.9847e-02, PNorm = 887.6106, GNorm = 1.9916, lr_0 = 9.9292e-04
Validation auc = 0.703344
Epoch 9988
Loss = 6.5160e-02, PNorm = 887.6612, GNorm = 6.2644, lr_0 = 9.9292e-04
Validation auc = 0.706324
Epoch 9989
Loss = 2.3382e-02, PNorm = 887.6986, GNorm = 3.5201, lr_0 = 9.9292e-04
Loss = 6.7850e-02, PNorm = 887.7313, GNorm = 1.6395, lr_0 = 9.9292e-04
Validation auc = 0.702848
Epoch 9990
Loss = 4.4656e-02, PNorm = 887.7682, GNorm = 1.7102, lr_0 = 9.9292e-04
Validation auc = 0.703522
Epoch 9991
Loss = 4.3906e-02, PNorm = 887.8075, GNorm = 0.6577, lr_0 = 9.9292e-04
Validation auc = 0.704018
Epoch 9992
Loss = 5.1494e-02, PNorm = 887.8450, GNorm = 4.1940, lr_0 = 9.9292e-04
Validation auc = 0.706931
Epoch 9993
Loss = 1.0275e-02, PNorm = 887.8797, GNorm = 0.5365, lr_0 = 9.9292e-04
Validation auc = 0.711145
Epoch 9994
Loss = 2.1439e-02, PNorm = 887.9010, GNorm = 0.1960, lr_0 = 9.9292e-04
Validation auc = 0.712584
Epoch 9995
Loss = 2.7816e-02, PNorm = 887.9167, GNorm = 4.2208, lr_0 = 9.9292e-04
Validation auc = 0.711525
Epoch 9996
Loss = 4.2280e-02, PNorm = 887.9372, GNorm = 2.6955, lr_0 = 9.9291e-04
Validation auc = 0.712639
Epoch 9997
Loss = 7.7030e-02, PNorm = 887.9904, GNorm = 3.3228, lr_0 = 9.9291e-04
Validation auc = 0.714541
Epoch 9998
Loss = 2.1621e-02, PNorm = 888.0492, GNorm = 2.1664, lr_0 = 9.9291e-04
Validation auc = 0.711185
Epoch 9999
Loss = 1.3901e-03, PNorm = 888.0900, GNorm = 0.1119, lr_0 = 9.9291e-04
Loss = 7.3777e-02, PNorm = 888.1317, GNorm = 7.7820, lr_0 = 9.9291e-04
Validation auc = 0.712113
Model 0 best validation auc = 0.782270 on epoch 360
Loading pretrained parameter "encoder.encoder.0.cached_zero_vector".
Loading pretrained parameter "encoder.encoder.0.W_i.weight".
Loading pretrained parameter "encoder.encoder.0.W_h.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.weight".
Loading pretrained parameter "encoder.encoder.0.W_o.bias".
Loading pretrained parameter "ffn.1.weight".
Loading pretrained parameter "ffn.1.bias".
Loading pretrained parameter "ffn.4.weight".
Loading pretrained parameter "ffn.4.bias".
Loading pretrained parameter "ffn.7.weight".
Loading pretrained parameter "ffn.7.bias".
Moving model to cuda
Model 0 test auc = 0.814895
Ensemble test auc = 0.814895
1-fold cross validation
	Seed 0 ==> test auc = 0.814895
Overall test auc = 0.814895 +/- 0.000000
Elapsed time = 4 days, 6:21:47
